2023-07-14 09:12:21,976 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 09:12:22,236 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da 2023-07-14 09:12:22,236 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-14 09:12:22,274 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 09:12:22,529 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 09:12:22,530 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572, deleteOnExit=true 2023-07-14 09:12:22,530 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 09:12:22,531 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/test.cache.data in system properties and HBase conf 2023-07-14 09:12:22,531 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 09:12:22,532 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop.log.dir in system properties and HBase conf 2023-07-14 09:12:22,532 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 09:12:22,533 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 09:12:22,533 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 09:12:22,918 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 09:12:22,923 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:22,924 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:22,924 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 09:12:22,925 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:22,925 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 09:12:22,926 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 09:12:22,926 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:22,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:22,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 09:12:22,927 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/nfs.dump.dir in system properties and HBase conf 2023-07-14 09:12:22,928 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir in system properties and HBase conf 2023-07-14 09:12:22,928 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:22,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 09:12:22,929 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 09:12:23,577 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 09:12:23,581 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 09:12:23,863 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 09:12:24,028 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 09:12:24,042 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:24,081 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:24,115 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_localhost_41745_hdfs____vct3ph/webapp 2023-07-14 09:12:24,260 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41745 2023-07-14 09:12:24,299 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 09:12:24,299 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 09:12:24,895 WARN [Listener at localhost/43917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:25,025 WARN [Listener at localhost/43917] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 09:12:25,054 WARN [Listener at localhost/43917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:25,063 INFO [Listener at localhost/43917] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:25,071 INFO [Listener at localhost/43917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_localhost_37049_datanode____.3ebzyg/webapp 2023-07-14 09:12:25,211 INFO [Listener at localhost/43917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37049 2023-07-14 09:12:25,821 WARN [Listener at localhost/43645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:25,881 WARN [Listener at localhost/43645] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 09:12:25,890 WARN [Listener at localhost/43645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:25,892 INFO [Listener at localhost/43645] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:25,900 INFO [Listener at localhost/43645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_localhost_46229_datanode____mzch3y/webapp 2023-07-14 09:12:26,034 INFO [Listener at localhost/43645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46229 2023-07-14 09:12:26,062 WARN [Listener at localhost/44229] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:26,096 WARN [Listener at localhost/44229] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 09:12:26,099 WARN [Listener at localhost/44229] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:26,100 INFO [Listener at localhost/44229] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:26,105 INFO [Listener at localhost/44229] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_localhost_39851_datanode____.3gndrf/webapp 2023-07-14 09:12:26,280 INFO [Listener at localhost/44229] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39851 2023-07-14 09:12:26,327 WARN [Listener at localhost/38149] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 09:12:26,676 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6aeded9560d63ceb: Processing first storage report for DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2 from datanode 46f2c305-fe99-42ec-833e-254a73fca670 2023-07-14 09:12:26,678 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6aeded9560d63ceb: from storage DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2 node DatanodeRegistration(127.0.0.1:36889, datanodeUuid=46f2c305-fe99-42ec-833e-254a73fca670, infoPort=42907, infoSecurePort=0, ipcPort=44229, storageInfo=lv=-57;cid=testClusterID;nsid=1889807593;c=1689325943648), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,678 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x408f870a2fe55323: Processing first storage report for DS-63a290d7-ed00-4637-a384-3ac9f32afece from datanode dc9a4f0b-9fe1-4408-be0f-f8e75ae05747 2023-07-14 09:12:26,678 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x408f870a2fe55323: from storage DS-63a290d7-ed00-4637-a384-3ac9f32afece node DatanodeRegistration(127.0.0.1:44353, datanodeUuid=dc9a4f0b-9fe1-4408-be0f-f8e75ae05747, infoPort=43199, infoSecurePort=0, ipcPort=43645, storageInfo=lv=-57;cid=testClusterID;nsid=1889807593;c=1689325943648), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,678 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6aeded9560d63ceb: Processing first storage report for DS-55fa685e-40a7-4f84-870f-e2a968eb4e5d from datanode 46f2c305-fe99-42ec-833e-254a73fca670 2023-07-14 09:12:26,678 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6aeded9560d63ceb: from storage DS-55fa685e-40a7-4f84-870f-e2a968eb4e5d node DatanodeRegistration(127.0.0.1:36889, datanodeUuid=46f2c305-fe99-42ec-833e-254a73fca670, infoPort=42907, infoSecurePort=0, ipcPort=44229, storageInfo=lv=-57;cid=testClusterID;nsid=1889807593;c=1689325943648), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,679 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x408f870a2fe55323: Processing first storage report for DS-0ab015e1-f290-4e1c-864a-e614823ceb58 from datanode dc9a4f0b-9fe1-4408-be0f-f8e75ae05747 2023-07-14 09:12:26,679 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x408f870a2fe55323: from storage DS-0ab015e1-f290-4e1c-864a-e614823ceb58 node DatanodeRegistration(127.0.0.1:44353, datanodeUuid=dc9a4f0b-9fe1-4408-be0f-f8e75ae05747, infoPort=43199, infoSecurePort=0, ipcPort=43645, storageInfo=lv=-57;cid=testClusterID;nsid=1889807593;c=1689325943648), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,682 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c924ddc24dea728: Processing first storage report for DS-cda992e0-3509-4ee5-ad45-ba1379144387 from datanode 306b56a2-a7b2-450d-a24d-74b81cb98f8e 2023-07-14 09:12:26,682 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c924ddc24dea728: from storage DS-cda992e0-3509-4ee5-ad45-ba1379144387 node DatanodeRegistration(127.0.0.1:44419, datanodeUuid=306b56a2-a7b2-450d-a24d-74b81cb98f8e, infoPort=33971, infoSecurePort=0, ipcPort=38149, storageInfo=lv=-57;cid=testClusterID;nsid=1889807593;c=1689325943648), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 09:12:26,682 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c924ddc24dea728: Processing first storage report for DS-67bb11a6-5119-45f5-b721-53dee73213c7 from datanode 306b56a2-a7b2-450d-a24d-74b81cb98f8e 2023-07-14 09:12:26,683 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c924ddc24dea728: from storage DS-67bb11a6-5119-45f5-b721-53dee73213c7 node DatanodeRegistration(127.0.0.1:44419, datanodeUuid=306b56a2-a7b2-450d-a24d-74b81cb98f8e, infoPort=33971, infoSecurePort=0, ipcPort=38149, storageInfo=lv=-57;cid=testClusterID;nsid=1889807593;c=1689325943648), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 09:12:27,022 DEBUG [Listener at localhost/38149] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da 2023-07-14 09:12:27,129 INFO [Listener at localhost/38149] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/zookeeper_0, clientPort=63612, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 09:12:27,154 INFO [Listener at localhost/38149] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63612 2023-07-14 09:12:27,165 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:27,167 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:27,851 INFO [Listener at localhost/38149] util.FSUtils(471): Created version file at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 with version=8 2023-07-14 09:12:27,851 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/hbase-staging 2023-07-14 09:12:28,245 INFO [Listener at localhost/38149] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 09:12:28,942 INFO [Listener at localhost/38149] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:28,986 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:28,987 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:28,987 INFO [Listener at localhost/38149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:28,988 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:28,988 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:29,178 INFO [Listener at localhost/38149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:29,282 DEBUG [Listener at localhost/38149] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 09:12:29,414 INFO [Listener at localhost/38149] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35455 2023-07-14 09:12:29,433 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,436 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,466 INFO [Listener at localhost/38149] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35455 connecting to ZooKeeper ensemble=127.0.0.1:63612 2023-07-14 09:12:29,536 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:354550x0, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:29,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35455-0x101630d0c860000 connected 2023-07-14 09:12:29,616 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:29,617 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:29,632 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:29,643 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35455 2023-07-14 09:12:29,648 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35455 2023-07-14 09:12:29,648 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35455 2023-07-14 09:12:29,651 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35455 2023-07-14 09:12:29,653 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35455 2023-07-14 09:12:29,667 INFO [Listener at localhost/38149] master.HMaster(444): hbase.rootdir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, hbase.cluster.distributed=false 2023-07-14 09:12:29,777 INFO [Listener at localhost/38149] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:29,778 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,778 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,778 INFO [Listener at localhost/38149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:29,778 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,779 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:29,785 INFO [Listener at localhost/38149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:29,789 INFO [Listener at localhost/38149] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42505 2023-07-14 09:12:29,793 INFO [Listener at localhost/38149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 09:12:29,818 DEBUG [Listener at localhost/38149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 09:12:29,819 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,822 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,824 INFO [Listener at localhost/38149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42505 connecting to ZooKeeper ensemble=127.0.0.1:63612 2023-07-14 09:12:29,842 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:425050x0, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:29,844 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:425050x0, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:29,850 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:425050x0, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:29,852 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:425050x0, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:29,874 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42505 2023-07-14 09:12:29,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42505-0x101630d0c860001 connected 2023-07-14 09:12:29,877 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42505 2023-07-14 09:12:29,885 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42505 2023-07-14 09:12:29,895 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42505 2023-07-14 09:12:29,897 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42505 2023-07-14 09:12:29,931 INFO [Listener at localhost/38149] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:29,933 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,933 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,934 INFO [Listener at localhost/38149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:29,934 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:29,935 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:29,935 INFO [Listener at localhost/38149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:29,944 INFO [Listener at localhost/38149] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41907 2023-07-14 09:12:29,944 INFO [Listener at localhost/38149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 09:12:29,965 DEBUG [Listener at localhost/38149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 09:12:29,966 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,983 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:29,991 INFO [Listener at localhost/38149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41907 connecting to ZooKeeper ensemble=127.0.0.1:63612 2023-07-14 09:12:30,009 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:419070x0, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:30,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41907-0x101630d0c860002 connected 2023-07-14 09:12:30,015 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:30,016 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:30,017 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:30,022 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41907 2023-07-14 09:12:30,022 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41907 2023-07-14 09:12:30,029 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41907 2023-07-14 09:12:30,034 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41907 2023-07-14 09:12:30,035 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41907 2023-07-14 09:12:30,050 INFO [Listener at localhost/38149] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 09:12:30,050 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:30,050 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:30,051 INFO [Listener at localhost/38149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 09:12:30,051 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 09:12:30,051 INFO [Listener at localhost/38149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 09:12:30,051 INFO [Listener at localhost/38149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 09:12:30,055 INFO [Listener at localhost/38149] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38061 2023-07-14 09:12:30,055 INFO [Listener at localhost/38149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 09:12:30,061 DEBUG [Listener at localhost/38149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 09:12:30,062 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:30,064 INFO [Listener at localhost/38149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:30,065 INFO [Listener at localhost/38149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38061 connecting to ZooKeeper ensemble=127.0.0.1:63612 2023-07-14 09:12:30,084 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:380610x0, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 09:12:30,086 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:380610x0, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:12:30,087 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:380610x0, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:12:30,088 DEBUG [Listener at localhost/38149] zookeeper.ZKUtil(164): regionserver:380610x0, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 09:12:30,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38061-0x101630d0c860003 connected 2023-07-14 09:12:30,094 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38061 2023-07-14 09:12:30,094 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38061 2023-07-14 09:12:30,098 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38061 2023-07-14 09:12:30,104 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38061 2023-07-14 09:12:30,105 DEBUG [Listener at localhost/38149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38061 2023-07-14 09:12:30,108 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:30,120 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 09:12:30,124 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:30,162 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,162 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,162 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,162 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 09:12:30,164 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:30,165 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 09:12:30,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 09:12:30,169 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,35455,1689325948029 from backup master directory 2023-07-14 09:12:30,174 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:30,175 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 09:12:30,176 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:30,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:30,180 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 09:12:30,182 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 09:12:30,363 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/hbase.id with ID: ef687999-6356-486a-965c-19fef08ac030 2023-07-14 09:12:30,419 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 09:12:30,444 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:30,579 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x07d32e27 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:30,662 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62df57c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:30,700 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:30,702 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 09:12:30,731 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 09:12:30,731 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 09:12:30,734 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 09:12:30,740 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 09:12:30,742 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:30,806 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store-tmp 2023-07-14 09:12:30,872 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:30,873 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 09:12:30,873 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,873 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,873 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 09:12:30,873 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,874 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:12:30,874 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 09:12:30,876 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/WALs/jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:30,912 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35455%2C1689325948029, suffix=, logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/WALs/jenkins-hbase9.apache.org,35455,1689325948029, archiveDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/oldWALs, maxLogs=10 2023-07-14 09:12:31,042 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK] 2023-07-14 09:12:31,042 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK] 2023-07-14 09:12:31,032 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK] 2023-07-14 09:12:31,059 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 09:12:31,167 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/WALs/jenkins-hbase9.apache.org,35455,1689325948029/jenkins-hbase9.apache.org%2C35455%2C1689325948029.1689325950929 2023-07-14 09:12:31,176 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK], DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK], DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK]] 2023-07-14 09:12:31,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:31,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:31,194 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,197 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,313 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,325 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 09:12:31,371 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 09:12:31,389 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:31,396 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,399 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,432 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 09:12:31,449 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:31,452 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60769260, jitterRate=-0.09446746110916138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:31,452 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 09:12:31,458 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 09:12:31,507 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 09:12:31,508 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 09:12:31,511 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 09:12:31,518 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 5 msec 2023-07-14 09:12:31,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-14 09:12:31,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 09:12:31,619 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 09:12:31,628 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 09:12:31,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 09:12:31,681 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 09:12:31,683 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 09:12:31,690 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 09:12:31,695 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 09:12:31,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,700 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 09:12:31,701 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 09:12:31,718 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 09:12:31,726 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,726 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,726 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,726 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,726 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 09:12:31,734 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,35455,1689325948029, sessionid=0x101630d0c860000, setting cluster-up flag (Was=false) 2023-07-14 09:12:31,759 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,765 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 09:12:31,767 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:31,781 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:31,795 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 09:12:31,799 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:31,803 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp 2023-07-14 09:12:31,816 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(951): ClusterId : ef687999-6356-486a-965c-19fef08ac030 2023-07-14 09:12:31,836 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(951): ClusterId : ef687999-6356-486a-965c-19fef08ac030 2023-07-14 09:12:31,832 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(951): ClusterId : ef687999-6356-486a-965c-19fef08ac030 2023-07-14 09:12:31,846 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 09:12:31,846 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 09:12:31,847 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 09:12:31,863 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 09:12:31,864 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 09:12:31,870 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 09:12:31,870 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 09:12:31,872 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 09:12:31,872 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 09:12:31,876 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 09:12:31,878 DEBUG [RS:2;jenkins-hbase9:38061] zookeeper.ReadOnlyZKClient(139): Connect 0x2509b94a to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:31,882 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 09:12:31,899 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 09:12:31,906 DEBUG [RS:1;jenkins-hbase9:41907] zookeeper.ReadOnlyZKClient(139): Connect 0x0bfc9d15 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:31,914 DEBUG [RS:0;jenkins-hbase9:42505] zookeeper.ReadOnlyZKClient(139): Connect 0x26e96a3e to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:31,955 DEBUG [RS:2;jenkins-hbase9:38061] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6187430c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:31,963 DEBUG [RS:2;jenkins-hbase9:38061] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79b8e150, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:12:32,019 DEBUG [RS:0;jenkins-hbase9:42505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60682309, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:32,020 DEBUG [RS:0;jenkins-hbase9:42505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35f5313d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:12:32,027 DEBUG [RS:1;jenkins-hbase9:41907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34edaccb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:32,027 DEBUG [RS:1;jenkins-hbase9:41907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73590368, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:12:32,027 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:38061 2023-07-14 09:12:32,032 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 09:12:32,034 INFO [RS:2;jenkins-hbase9:38061] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 09:12:32,034 INFO [RS:2;jenkins-hbase9:38061] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 09:12:32,039 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,040 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 09:12:32,041 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 09:12:32,039 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:41907 2023-07-14 09:12:32,046 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:42505 2023-07-14 09:12:32,042 INFO [RS:2;jenkins-hbase9:38061] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,046 INFO [RS:0;jenkins-hbase9:42505] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 09:12:32,047 INFO [RS:1;jenkins-hbase9:41907] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 09:12:32,048 INFO [RS:0;jenkins-hbase9:42505] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 09:12:32,048 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 09:12:32,048 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 09:12:32,048 INFO [RS:1;jenkins-hbase9:41907] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 09:12:32,049 INFO [RS:0;jenkins-hbase9:42505] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,049 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 09:12:32,049 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 09:12:32,049 INFO [RS:1;jenkins-hbase9:41907] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:32,049 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 09:12:32,052 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35455,1689325948029 with isa=jenkins-hbase9.apache.org/172.31.2.10:42505, startcode=1689325949776 2023-07-14 09:12:32,052 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35455,1689325948029 with isa=jenkins-hbase9.apache.org/172.31.2.10:38061, startcode=1689325950049 2023-07-14 09:12:32,052 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35455,1689325948029 with isa=jenkins-hbase9.apache.org/172.31.2.10:41907, startcode=1689325949930 2023-07-14 09:12:32,077 DEBUG [RS:2;jenkins-hbase9:38061] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 09:12:32,082 DEBUG [RS:0;jenkins-hbase9:42505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 09:12:32,081 DEBUG [RS:1;jenkins-hbase9:41907] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 09:12:32,152 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53777, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 09:12:32,158 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52925, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 09:12:32,171 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35455] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 09:12:32,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 09:12:32,174 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39765, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 09:12:32,183 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35455] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 09:12:32,197 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35455] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 09:12:32,224 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,224 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,224 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,224 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 09:12:32,225 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 09:12:32,225 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,225 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,225 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,294 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689325982294 2023-07-14 09:12:32,297 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 09:12:32,304 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 09:12:32,304 WARN [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 09:12:32,304 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 09:12:32,304 WARN [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 09:12:32,304 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 09:12:32,304 WARN [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 09:12:32,308 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 09:12:32,309 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 09:12:32,315 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:32,316 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 09:12:32,325 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 09:12:32,325 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 09:12:32,326 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 09:12:32,326 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 09:12:32,331 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,350 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 09:12:32,355 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 09:12:32,355 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 09:12:32,366 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 09:12:32,366 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 09:12:32,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689325952369,5,FailOnTimeoutGroup] 2023-07-14 09:12:32,376 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689325952370,5,FailOnTimeoutGroup] 2023-07-14 09:12:32,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 09:12:32,379 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,379 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,407 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35455,1689325948029 with isa=jenkins-hbase9.apache.org/172.31.2.10:38061, startcode=1689325950049 2023-07-14 09:12:32,410 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35455,1689325948029 with isa=jenkins-hbase9.apache.org/172.31.2.10:41907, startcode=1689325949930 2023-07-14 09:12:32,407 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,35455,1689325948029 with isa=jenkins-hbase9.apache.org/172.31.2.10:42505, startcode=1689325949776 2023-07-14 09:12:32,428 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35455] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,439 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:32,443 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:12:32,443 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:32,443 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43917 2023-07-14 09:12:32,444 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 09:12:32,444 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35455] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,443 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:12:32,458 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:12:32,458 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35455] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,480 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:12:32,480 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43917 2023-07-14 09:12:32,480 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 09:12:32,483 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,42505,1689325949776] 2023-07-14 09:12:32,485 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:12:32,485 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43917 2023-07-14 09:12:32,485 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 09:12:32,486 DEBUG [RS:0;jenkins-hbase9:42505] zookeeper.ZKUtil(162): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,486 WARN [RS:0;jenkins-hbase9:42505] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:32,487 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:12:32,487 INFO [RS:0;jenkins-hbase9:42505] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:32,487 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,498 DEBUG [RS:1;jenkins-hbase9:41907] zookeeper.ZKUtil(162): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,498 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41907,1689325949930] 2023-07-14 09:12:32,498 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,38061,1689325950049] 2023-07-14 09:12:32,498 WARN [RS:1;jenkins-hbase9:41907] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:32,498 DEBUG [RS:2;jenkins-hbase9:38061] zookeeper.ZKUtil(162): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,498 INFO [RS:1;jenkins-hbase9:41907] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:32,498 WARN [RS:2;jenkins-hbase9:38061] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 09:12:32,499 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,499 INFO [RS:2;jenkins-hbase9:38061] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:32,499 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,564 DEBUG [RS:1;jenkins-hbase9:41907] zookeeper.ZKUtil(162): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,565 DEBUG [RS:0;jenkins-hbase9:42505] zookeeper.ZKUtil(162): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,565 DEBUG [RS:2;jenkins-hbase9:38061] zookeeper.ZKUtil(162): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,565 DEBUG [RS:0;jenkins-hbase9:42505] zookeeper.ZKUtil(162): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,565 DEBUG [RS:1;jenkins-hbase9:41907] zookeeper.ZKUtil(162): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,566 DEBUG [RS:0;jenkins-hbase9:42505] zookeeper.ZKUtil(162): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,566 DEBUG [RS:1;jenkins-hbase9:41907] zookeeper.ZKUtil(162): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,567 DEBUG [RS:2;jenkins-hbase9:38061] zookeeper.ZKUtil(162): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,571 DEBUG [RS:2;jenkins-hbase9:38061] zookeeper.ZKUtil(162): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,592 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 09:12:32,592 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 09:12:32,592 DEBUG [RS:1;jenkins-hbase9:41907] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 09:12:32,600 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:32,608 INFO [RS:1;jenkins-hbase9:41907] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 09:12:32,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 09:12:32,623 INFO [RS:0;jenkins-hbase9:42505] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 09:12:32,623 INFO [RS:2;jenkins-hbase9:38061] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 09:12:32,633 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/info 2023-07-14 09:12:32,634 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 09:12:32,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:32,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 09:12:32,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/rep_barrier 2023-07-14 09:12:32,653 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 09:12:32,668 INFO [RS:1;jenkins-hbase9:41907] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 09:12:32,686 INFO [RS:2;jenkins-hbase9:38061] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 09:12:32,707 INFO [RS:0;jenkins-hbase9:42505] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 09:12:32,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:32,714 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 09:12:32,718 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/table 2023-07-14 09:12:32,719 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 09:12:32,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:32,722 INFO [RS:1;jenkins-hbase9:41907] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 09:12:32,741 INFO [RS:2;jenkins-hbase9:38061] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 09:12:32,746 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,734 INFO [RS:0;jenkins-hbase9:42505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 09:12:32,748 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740 2023-07-14 09:12:32,749 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740 2023-07-14 09:12:32,749 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 09:12:32,747 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,747 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,760 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 09:12:32,771 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 09:12:32,775 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 09:12:32,777 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,777 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,778 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 09:12:32,778 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,779 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,779 DEBUG [RS:2;jenkins-hbase9:38061] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,806 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,806 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,806 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,807 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,807 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,807 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,807 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,808 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,808 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,808 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,808 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,808 DEBUG [RS:1;jenkins-hbase9:41907] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,806 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,809 DEBUG [RS:0;jenkins-hbase9:42505] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 09:12:32,818 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,818 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,818 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,838 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:32,839 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73221567, jitterRate=0.09108637273311615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 09:12:32,839 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 09:12:32,840 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 09:12:32,840 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 09:12:32,840 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 09:12:32,840 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 09:12:32,840 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 09:12:32,845 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,845 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,845 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,878 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,880 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,880 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,878 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 09:12:32,881 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 09:12:32,885 INFO [RS:0;jenkins-hbase9:42505] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 09:12:32,889 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 09:12:32,889 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 09:12:32,889 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42505,1689325949776-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,896 INFO [RS:1;jenkins-hbase9:41907] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 09:12:32,912 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41907,1689325949930-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,892 INFO [RS:2;jenkins-hbase9:38061] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 09:12:32,918 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38061,1689325950049-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:32,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 09:12:32,954 INFO [RS:1;jenkins-hbase9:41907] regionserver.Replication(203): jenkins-hbase9.apache.org,41907,1689325949930 started 2023-07-14 09:12:32,954 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,41907,1689325949930, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41907, sessionid=0x101630d0c860002 2023-07-14 09:12:32,954 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 09:12:32,954 DEBUG [RS:1;jenkins-hbase9:41907] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,955 DEBUG [RS:1;jenkins-hbase9:41907] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41907,1689325949930' 2023-07-14 09:12:32,955 DEBUG [RS:1;jenkins-hbase9:41907] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 09:12:32,957 DEBUG [RS:1;jenkins-hbase9:41907] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 09:12:32,958 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 09:12:32,966 INFO [RS:0;jenkins-hbase9:42505] regionserver.Replication(203): jenkins-hbase9.apache.org,42505,1689325949776 started 2023-07-14 09:12:32,961 INFO [RS:2;jenkins-hbase9:38061] regionserver.Replication(203): jenkins-hbase9.apache.org,38061,1689325950049 started 2023-07-14 09:12:32,967 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 09:12:32,967 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,42505,1689325949776, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:42505, sessionid=0x101630d0c860001 2023-07-14 09:12:32,967 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,38061,1689325950049, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:38061, sessionid=0x101630d0c860003 2023-07-14 09:12:32,968 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 09:12:32,968 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 09:12:32,968 DEBUG [RS:1;jenkins-hbase9:41907] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:32,968 DEBUG [RS:1;jenkins-hbase9:41907] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41907,1689325949930' 2023-07-14 09:12:32,968 DEBUG [RS:1;jenkins-hbase9:41907] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:32,968 DEBUG [RS:0;jenkins-hbase9:42505] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,974 DEBUG [RS:1;jenkins-hbase9:41907] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:32,976 DEBUG [RS:1;jenkins-hbase9:41907] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 09:12:32,976 INFO [RS:1;jenkins-hbase9:41907] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 09:12:32,976 INFO [RS:1;jenkins-hbase9:41907] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 09:12:32,974 DEBUG [RS:0;jenkins-hbase9:42505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42505,1689325949776' 2023-07-14 09:12:32,978 DEBUG [RS:0;jenkins-hbase9:42505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 09:12:32,968 DEBUG [RS:2;jenkins-hbase9:38061] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,978 DEBUG [RS:2;jenkins-hbase9:38061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38061,1689325950049' 2023-07-14 09:12:32,978 DEBUG [RS:2;jenkins-hbase9:38061] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 09:12:32,978 DEBUG [RS:0;jenkins-hbase9:42505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 09:12:32,978 DEBUG [RS:2;jenkins-hbase9:38061] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 09:12:32,979 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 09:12:32,979 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 09:12:32,979 DEBUG [RS:0;jenkins-hbase9:42505] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:32,979 DEBUG [RS:0;jenkins-hbase9:42505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,42505,1689325949776' 2023-07-14 09:12:32,980 DEBUG [RS:0;jenkins-hbase9:42505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:32,984 DEBUG [RS:0;jenkins-hbase9:42505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:32,985 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 09:12:32,985 DEBUG [RS:0;jenkins-hbase9:42505] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 09:12:32,985 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 09:12:32,985 DEBUG [RS:2;jenkins-hbase9:38061] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:32,985 DEBUG [RS:2;jenkins-hbase9:38061] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38061,1689325950049' 2023-07-14 09:12:32,985 DEBUG [RS:2;jenkins-hbase9:38061] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:32,985 INFO [RS:0;jenkins-hbase9:42505] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 09:12:32,986 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 09:12:32,989 INFO [RS:0;jenkins-hbase9:42505] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 09:12:32,991 DEBUG [RS:2;jenkins-hbase9:38061] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:32,991 DEBUG [RS:2;jenkins-hbase9:38061] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 09:12:32,991 INFO [RS:2;jenkins-hbase9:38061] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 09:12:32,992 INFO [RS:2;jenkins-hbase9:38061] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 09:12:32,995 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 09:12:33,090 INFO [RS:1;jenkins-hbase9:41907] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41907%2C1689325949930, suffix=, logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,41907,1689325949930, archiveDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs, maxLogs=32 2023-07-14 09:12:33,095 INFO [RS:2;jenkins-hbase9:38061] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38061%2C1689325950049, suffix=, logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,38061,1689325950049, archiveDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs, maxLogs=32 2023-07-14 09:12:33,103 INFO [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42505%2C1689325949776, suffix=, logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,42505,1689325949776, archiveDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs, maxLogs=32 2023-07-14 09:12:33,154 DEBUG [jenkins-hbase9:35455] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 09:12:33,159 DEBUG [jenkins-hbase9:35455] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:33,167 DEBUG [jenkins-hbase9:35455] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:33,167 DEBUG [jenkins-hbase9:35455] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:33,167 DEBUG [jenkins-hbase9:35455] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:33,167 DEBUG [jenkins-hbase9:35455] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:33,178 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK] 2023-07-14 09:12:33,179 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK] 2023-07-14 09:12:33,180 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK] 2023-07-14 09:12:33,181 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,42505,1689325949776, state=OPENING 2023-07-14 09:12:33,191 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK] 2023-07-14 09:12:33,191 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK] 2023-07-14 09:12:33,191 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK] 2023-07-14 09:12:33,197 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 09:12:33,199 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:33,200 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 09:12:33,210 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK] 2023-07-14 09:12:33,211 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK] 2023-07-14 09:12:33,210 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK] 2023-07-14 09:12:33,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:12:33,224 INFO [RS:1;jenkins-hbase9:41907] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,41907,1689325949930/jenkins-hbase9.apache.org%2C41907%2C1689325949930.1689325953093 2023-07-14 09:12:33,226 INFO [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,42505,1689325949776/jenkins-hbase9.apache.org%2C42505%2C1689325949776.1689325953105 2023-07-14 09:12:33,233 DEBUG [RS:1;jenkins-hbase9:41907] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK], DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK], DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK]] 2023-07-14 09:12:33,233 DEBUG [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK], DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK], DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK]] 2023-07-14 09:12:33,237 INFO [RS:2;jenkins-hbase9:38061] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,38061,1689325950049/jenkins-hbase9.apache.org%2C38061%2C1689325950049.1689325953098 2023-07-14 09:12:33,237 DEBUG [RS:2;jenkins-hbase9:38061] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK], DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK], DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK]] 2023-07-14 09:12:33,439 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:33,442 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:12:33,454 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:12:33,498 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 09:12:33,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 09:12:33,503 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42505%2C1689325949776.meta, suffix=.meta, logDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,42505,1689325949776, archiveDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs, maxLogs=32 2023-07-14 09:12:33,542 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK] 2023-07-14 09:12:33,562 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK] 2023-07-14 09:12:33,563 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK] 2023-07-14 09:12:33,593 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/WALs/jenkins-hbase9.apache.org,42505,1689325949776/jenkins-hbase9.apache.org%2C42505%2C1689325949776.meta.1689325953504.meta 2023-07-14 09:12:33,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36889,DS-d676ebe4-f9c3-4da1-8c4b-15b7438b55b2,DISK], DatanodeInfoWithStorage[127.0.0.1:44353,DS-63a290d7-ed00-4637-a384-3ac9f32afece,DISK], DatanodeInfoWithStorage[127.0.0.1:44419,DS-cda992e0-3509-4ee5-ad45-ba1379144387,DISK]] 2023-07-14 09:12:33,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:33,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 09:12:33,604 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:33,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 09:12:33,609 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 09:12:33,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 09:12:33,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 09:12:33,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:33,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 09:12:33,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 09:12:33,641 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 09:12:33,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/info 2023-07-14 09:12:33,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/info 2023-07-14 09:12:33,646 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 09:12:33,647 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:33,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 09:12:33,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/rep_barrier 2023-07-14 09:12:33,649 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/rep_barrier 2023-07-14 09:12:33,650 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 09:12:33,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:33,651 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 09:12:33,652 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/table 2023-07-14 09:12:33,652 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/table 2023-07-14 09:12:33,653 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 09:12:33,654 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:33,656 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740 2023-07-14 09:12:33,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740 2023-07-14 09:12:33,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 09:12:33,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 09:12:33,682 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67797071, jitterRate=0.010255083441734314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 09:12:33,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 09:12:33,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689325953427 2023-07-14 09:12:33,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 09:12:33,732 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 09:12:33,732 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,42505,1689325949776, state=OPEN 2023-07-14 09:12:33,735 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 09:12:33,735 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 09:12:33,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 09:12:33,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,42505,1689325949776 in 520 msec 2023-07-14 09:12:33,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 09:12:33,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 802 msec 2023-07-14 09:12:33,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7060 sec 2023-07-14 09:12:33,765 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689325953764, completionTime=-1 2023-07-14 09:12:33,765 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 09:12:33,765 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 09:12:33,866 DEBUG [hconnection-0x16882c96-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:33,872 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:33,901 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 09:12:33,901 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689326013901 2023-07-14 09:12:33,901 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689326073901 2023-07-14 09:12:33,901 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 136 msec 2023-07-14 09:12:33,944 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35455,1689325948029-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35455,1689325948029-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,945 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35455,1689325948029-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,948 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:35455, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,948 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 09:12:33,957 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 09:12:33,971 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 09:12:33,973 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:33,991 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 09:12:33,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:12:33,998 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:12:34,029 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,037 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c empty. 2023-07-14 09:12:34,038 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,039 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 09:12:34,098 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:34,101 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8420ef18efacc28679bf65a4aab0bd8c, NAME => 'hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:12:34,118 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:34,118 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8420ef18efacc28679bf65a4aab0bd8c, disabling compactions & flushes 2023-07-14 09:12:34,118 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,118 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,118 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. after waiting 0 ms 2023-07-14 09:12:34,118 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,118 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,118 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8420ef18efacc28679bf65a4aab0bd8c: 2023-07-14 09:12:34,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:12:34,140 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689325954127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325954127"}]},"ts":"1689325954127"} 2023-07-14 09:12:34,175 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 09:12:34,177 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:12:34,183 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325954177"}]},"ts":"1689325954177"} 2023-07-14 09:12:34,188 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 09:12:34,194 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:34,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:34,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:34,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:34,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:34,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8420ef18efacc28679bf65a4aab0bd8c, ASSIGN}] 2023-07-14 09:12:34,203 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8420ef18efacc28679bf65a4aab0bd8c, ASSIGN 2023-07-14 09:12:34,204 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8420ef18efacc28679bf65a4aab0bd8c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42505,1689325949776; forceNewPlan=false, retain=false 2023-07-14 09:12:34,358 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 09:12:34,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8420ef18efacc28679bf65a4aab0bd8c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:34,359 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689325954359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325954359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325954359"}]},"ts":"1689325954359"} 2023-07-14 09:12:34,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8420ef18efacc28679bf65a4aab0bd8c, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:12:34,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8420ef18efacc28679bf65a4aab0bd8c, NAME => 'hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:34,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. service=AccessControlService 2023-07-14 09:12:34,533 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:34,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:34,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,539 INFO [StoreOpener-8420ef18efacc28679bf65a4aab0bd8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,542 DEBUG [StoreOpener-8420ef18efacc28679bf65a4aab0bd8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/info 2023-07-14 09:12:34,542 DEBUG [StoreOpener-8420ef18efacc28679bf65a4aab0bd8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/info 2023-07-14 09:12:34,543 INFO [StoreOpener-8420ef18efacc28679bf65a4aab0bd8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8420ef18efacc28679bf65a4aab0bd8c columnFamilyName info 2023-07-14 09:12:34,545 INFO [StoreOpener-8420ef18efacc28679bf65a4aab0bd8c-1] regionserver.HStore(310): Store=8420ef18efacc28679bf65a4aab0bd8c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:34,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,555 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:12:34,563 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:34,565 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8420ef18efacc28679bf65a4aab0bd8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59375294, jitterRate=-0.11523917317390442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:34,566 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8420ef18efacc28679bf65a4aab0bd8c: 2023-07-14 09:12:34,568 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c., pid=6, masterSystemTime=1689325954519 2023-07-14 09:12:34,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,575 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:12:34,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8420ef18efacc28679bf65a4aab0bd8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:34,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689325954575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325954575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325954575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325954575"}]},"ts":"1689325954575"} 2023-07-14 09:12:34,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 09:12:34,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8420ef18efacc28679bf65a4aab0bd8c, server=jenkins-hbase9.apache.org,42505,1689325949776 in 218 msec 2023-07-14 09:12:34,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 09:12:34,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8420ef18efacc28679bf65a4aab0bd8c, ASSIGN in 388 msec 2023-07-14 09:12:34,596 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:12:34,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325954596"}]},"ts":"1689325954596"} 2023-07-14 09:12:34,602 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 09:12:34,607 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:12:34,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 632 msec 2023-07-14 09:12:34,694 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 09:12:34,695 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 09:12:34,696 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:34,759 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 09:12:34,783 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 09:12:34,789 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 09:12:34,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 49 msec 2023-07-14 09:12:34,803 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 09:12:34,823 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 09:12:34,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-07-14 09:12:34,848 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 09:12:34,851 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 09:12:34,851 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.675sec 2023-07-14 09:12:34,856 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 09:12:34,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 09:12:34,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 09:12:34,859 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35455,1689325948029-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 09:12:34,860 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35455,1689325948029-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 09:12:34,871 DEBUG [Listener at localhost/38149] zookeeper.ReadOnlyZKClient(139): Connect 0x2f8c14a3 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:34,882 DEBUG [Listener at localhost/38149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7051d77a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:34,892 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:34,894 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 09:12:34,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:12:34,908 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:12:34,916 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 09:12:34,923 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:34,924 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/acl/923b5a133fa8498737d15883785c154a 2023-07-14 09:12:34,925 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/acl/923b5a133fa8498737d15883785c154a empty. 2023-07-14 09:12:34,926 DEBUG [hconnection-0x59bfdb6e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:34,928 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/acl/923b5a133fa8498737d15883785c154a 2023-07-14 09:12:34,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 09:12:34,950 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:34,954 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:12:34,955 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 09:12:34,955 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/test.cache.data in system properties and HBase conf 2023-07-14 09:12:34,955 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 09:12:34,955 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop.log.dir in system properties and HBase conf 2023-07-14 09:12:34,955 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 09:12:34,956 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/nfs.dump.dir in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 09:12:34,957 INFO [Listener at localhost/38149] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 09:12:34,984 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:35,000 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 923b5a133fa8498737d15883785c154a, NAME => 'hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:12:35,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:35,125 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:35,126 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 923b5a133fa8498737d15883785c154a, disabling compactions & flushes 2023-07-14 09:12:35,127 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,127 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,127 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. after waiting 0 ms 2023-07-14 09:12:35,127 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,127 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,127 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 923b5a133fa8498737d15883785c154a: 2023-07-14 09:12:35,134 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:12:35,136 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689325955136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325955136"}]},"ts":"1689325955136"} 2023-07-14 09:12:35,145 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 09:12:35,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:12:35,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325955148"}]},"ts":"1689325955148"} 2023-07-14 09:12:35,152 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 09:12:35,162 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:35,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:35,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:35,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:35,163 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:35,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=923b5a133fa8498737d15883785c154a, ASSIGN}] 2023-07-14 09:12:35,168 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=923b5a133fa8498737d15883785c154a, ASSIGN 2023-07-14 09:12:35,171 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=923b5a133fa8498737d15883785c154a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:12:35,230 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:35,321 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 09:12:35,322 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=923b5a133fa8498737d15883785c154a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:35,323 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689325955322"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325955322"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325955322"}]},"ts":"1689325955322"} 2023-07-14 09:12:35,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 923b5a133fa8498737d15883785c154a, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:12:35,484 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:35,484 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:12:35,488 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:12:35,505 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,506 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 923b5a133fa8498737d15883785c154a, NAME => 'hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:12:35,506 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. service=AccessControlService 2023-07-14 09:12:35,506 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:35,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:35,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,511 INFO [StoreOpener-923b5a133fa8498737d15883785c154a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,515 DEBUG [StoreOpener-923b5a133fa8498737d15883785c154a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/l 2023-07-14 09:12:35,515 DEBUG [StoreOpener-923b5a133fa8498737d15883785c154a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/l 2023-07-14 09:12:35,516 INFO [StoreOpener-923b5a133fa8498737d15883785c154a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 923b5a133fa8498737d15883785c154a columnFamilyName l 2023-07-14 09:12:35,517 INFO [StoreOpener-923b5a133fa8498737d15883785c154a-1] regionserver.HStore(310): Store=923b5a133fa8498737d15883785c154a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:35,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,530 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:35,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 923b5a133fa8498737d15883785c154a 2023-07-14 09:12:35,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:35,542 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 923b5a133fa8498737d15883785c154a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61119021, jitterRate=-0.08925561606884003}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:35,543 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 923b5a133fa8498737d15883785c154a: 2023-07-14 09:12:35,553 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a., pid=11, masterSystemTime=1689325955484 2023-07-14 09:12:35,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=923b5a133fa8498737d15883785c154a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:35,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:12:35,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689325955560"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325955560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325955560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325955560"}]},"ts":"1689325955560"} 2023-07-14 09:12:35,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 09:12:35,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 923b5a133fa8498737d15883785c154a, server=jenkins-hbase9.apache.org,38061,1689325950049 in 239 msec 2023-07-14 09:12:35,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 09:12:35,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=923b5a133fa8498737d15883785c154a, ASSIGN in 407 msec 2023-07-14 09:12:35,575 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:12:35,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325955575"}]},"ts":"1689325955575"} 2023-07-14 09:12:35,578 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 09:12:35,583 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:12:35,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 691 msec 2023-07-14 09:12:36,031 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 09:12:36,031 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 09:12:36,051 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 09:12:36,857 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:37,253 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:37,261 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_35987_jobhistory____.exwujq/webapp 2023-07-14 09:12:37,464 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 09:12:37,465 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:37,465 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:37,468 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:37,552 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:37,896 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:38,240 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:12:38,240 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 09:12:38,241 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:12:38,241 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 09:12:38,241 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 09:12:38,241 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 09:12:38,242 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:12:38,242 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 09:12:38,242 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 09:12:38,242 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 09:12:38,479 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 09:12:38,540 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:35987 2023-07-14 09:12:38,609 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 09:12:38,611 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 09:12:38,612 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 09:12:39,407 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:12:39,845 WARN [Listener at jenkins-hbase9.apache.org/43539] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:39,967 WARN [Listener at jenkins-hbase9.apache.org/43539] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 09:12:39,968 INFO [Listener at jenkins-hbase9.apache.org/43539] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:39,974 INFO [Listener at jenkins-hbase9.apache.org/43539] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_44545_cluster____2bapv7/webapp 2023-07-14 09:12:40,078 INFO [Listener at jenkins-hbase9.apache.org/43539] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:40,079 INFO [Listener at jenkins-hbase9.apache.org/43539] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 09:12:40,079 INFO [Listener at jenkins-hbase9.apache.org/43539] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:40,079 INFO [Listener at jenkins-hbase9.apache.org/43539] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:40,092 INFO [Listener at jenkins-hbase9.apache.org/43539] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:40,337 INFO [Listener at jenkins-hbase9.apache.org/43539] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:40,496 INFO [Listener at jenkins-hbase9.apache.org/43539] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:40,508 INFO [Listener at jenkins-hbase9.apache.org/43539] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:44545 2023-07-14 09:12:41,054 WARN [Listener at jenkins-hbase9.apache.org/36403] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:41,078 WARN [Listener at jenkins-hbase9.apache.org/36403] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 09:12:41,079 INFO [Listener at jenkins-hbase9.apache.org/36403] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:41,085 INFO [Listener at jenkins-hbase9.apache.org/36403] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_44291_node____aein1f/webapp 2023-07-14 09:12:41,139 INFO [Listener at jenkins-hbase9.apache.org/36403] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 09:12:41,140 INFO [Listener at jenkins-hbase9.apache.org/36403] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:41,140 INFO [Listener at jenkins-hbase9.apache.org/36403] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:41,140 INFO [Listener at jenkins-hbase9.apache.org/36403] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:41,147 INFO [Listener at jenkins-hbase9.apache.org/36403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,169 INFO [Listener at jenkins-hbase9.apache.org/36403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,258 INFO [Listener at jenkins-hbase9.apache.org/36403] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,298 INFO [Listener at jenkins-hbase9.apache.org/36403] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:44291 2023-07-14 09:12:41,858 WARN [Listener at jenkins-hbase9.apache.org/45963] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 09:12:41,866 WARN [Listener at jenkins-hbase9.apache.org/45963] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 09:12:41,867 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 09:12:41,887 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_39137_node____.x68mwo/webapp 2023-07-14 09:12:41,959 INFO [Listener at jenkins-hbase9.apache.org/45963] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 09:12:41,960 INFO [Listener at jenkins-hbase9.apache.org/45963] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 09:12:41,960 INFO [Listener at jenkins-hbase9.apache.org/45963] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 09:12:41,960 INFO [Listener at jenkins-hbase9.apache.org/45963] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 09:12:41,970 INFO [Listener at jenkins-hbase9.apache.org/45963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:41,985 INFO [Listener at jenkins-hbase9.apache.org/45963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:42,071 INFO [Listener at jenkins-hbase9.apache.org/45963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 09:12:42,104 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:39137 2023-07-14 09:12:42,137 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 09:12:42,139 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:42,208 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=672, ProcessCount=184, AvailableMemoryMB=3523 2023-07-14 09:12:42,208 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-14 09:12:42,225 DEBUG [Listener at jenkins-hbase9.apache.org/45963] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 09:12:42,232 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 09:12:42,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:12:42,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:12:42,247 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:12:42,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 09:12:42,251 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:12:42,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,258 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,263 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e empty. 2023-07-14 09:12:42,263 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,266 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,266 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 empty. 2023-07-14 09:12:42,267 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,267 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 09:12:42,344 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 09:12:42,346 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => a58198bebb30fe26f13fb18a277e058e, NAME => 'testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:12:42,356 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a78c2dcd76c9937c79c14e951bcbb187, NAME => 'testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:12:42,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,459 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,460 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing a58198bebb30fe26f13fb18a277e058e, disabling compactions & flushes 2023-07-14 09:12:42,460 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,460 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,460 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. after waiting 0 ms 2023-07-14 09:12:42,460 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,461 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,461 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for a58198bebb30fe26f13fb18a277e058e: 2023-07-14 09:12:42,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a78c2dcd76c9937c79c14e951bcbb187, disabling compactions & flushes 2023-07-14 09:12:42,466 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. after waiting 0 ms 2023-07-14 09:12:42,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,466 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a78c2dcd76c9937c79c14e951bcbb187: 2023-07-14 09:12:42,471 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:12:42,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325962472"}]},"ts":"1689325962472"} 2023-07-14 09:12:42,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325962472"}]},"ts":"1689325962472"} 2023-07-14 09:12:42,541 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:12:42,547 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:12:42,548 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325962547"}]},"ts":"1689325962547"} 2023-07-14 09:12:42,550 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 09:12:42,560 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:12:42,562 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:12:42,562 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:12:42,563 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:12:42,563 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:12:42,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, ASSIGN}] 2023-07-14 09:12:42,567 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, ASSIGN 2023-07-14 09:12:42,567 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, ASSIGN 2023-07-14 09:12:42,569 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:12:42,569 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42505,1689325949776; forceNewPlan=false, retain=false 2023-07-14 09:12:42,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,719 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:12:42,722 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a58198bebb30fe26f13fb18a277e058e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:42,722 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a78c2dcd76c9937c79c14e951bcbb187, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:42,723 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325962722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325962722"}]},"ts":"1689325962722"} 2023-07-14 09:12:42,723 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325962722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325962722"}]},"ts":"1689325962722"} 2023-07-14 09:12:42,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure a58198bebb30fe26f13fb18a277e058e, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:12:42,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure a78c2dcd76c9937c79c14e951bcbb187, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:12:42,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:42,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a58198bebb30fe26f13fb18a277e058e, NAME => 'testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:12:42,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. service=AccessControlService 2023-07-14 09:12:42,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a78c2dcd76c9937c79c14e951bcbb187, NAME => 'testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:12:42,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. service=AccessControlService 2023-07-14 09:12:42,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:12:42,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:12:42,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,892 INFO [StoreOpener-a58198bebb30fe26f13fb18a277e058e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,892 INFO [StoreOpener-a78c2dcd76c9937c79c14e951bcbb187-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,896 DEBUG [StoreOpener-a78c2dcd76c9937c79c14e951bcbb187-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf 2023-07-14 09:12:42,896 DEBUG [StoreOpener-a78c2dcd76c9937c79c14e951bcbb187-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf 2023-07-14 09:12:42,896 DEBUG [StoreOpener-a58198bebb30fe26f13fb18a277e058e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf 2023-07-14 09:12:42,896 DEBUG [StoreOpener-a58198bebb30fe26f13fb18a277e058e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf 2023-07-14 09:12:42,896 INFO [StoreOpener-a78c2dcd76c9937c79c14e951bcbb187-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a78c2dcd76c9937c79c14e951bcbb187 columnFamilyName cf 2023-07-14 09:12:42,897 INFO [StoreOpener-a58198bebb30fe26f13fb18a277e058e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a58198bebb30fe26f13fb18a277e058e columnFamilyName cf 2023-07-14 09:12:42,898 INFO [StoreOpener-a78c2dcd76c9937c79c14e951bcbb187-1] regionserver.HStore(310): Store=a78c2dcd76c9937c79c14e951bcbb187/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:42,898 INFO [StoreOpener-a58198bebb30fe26f13fb18a277e058e-1] regionserver.HStore(310): Store=a58198bebb30fe26f13fb18a277e058e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:12:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:12:42,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:12:42,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:42,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a58198bebb30fe26f13fb18a277e058e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71739888, jitterRate=0.06900763511657715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:42,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a58198bebb30fe26f13fb18a277e058e: 2023-07-14 09:12:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:12:42,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e., pid=15, masterSystemTime=1689325962880 2023-07-14 09:12:42,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a78c2dcd76c9937c79c14e951bcbb187; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62017688, jitterRate=-0.07586443424224854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:12:42,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a78c2dcd76c9937c79c14e951bcbb187: 2023-07-14 09:12:42,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:42,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187., pid=16, masterSystemTime=1689325962883 2023-07-14 09:12:42,932 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a58198bebb30fe26f13fb18a277e058e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:42,932 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962931"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325962931"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325962931"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325962931"}]},"ts":"1689325962931"} 2023-07-14 09:12:42,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:42,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a78c2dcd76c9937c79c14e951bcbb187, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:42,941 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325962936"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325962936"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325962936"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325962936"}]},"ts":"1689325962936"} 2023-07-14 09:12:42,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-14 09:12:42,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure a58198bebb30fe26f13fb18a277e058e, server=jenkins-hbase9.apache.org,42505,1689325949776 in 210 msec 2023-07-14 09:12:42,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, ASSIGN in 385 msec 2023-07-14 09:12:42,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-14 09:12:42,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure a78c2dcd76c9937c79c14e951bcbb187, server=jenkins-hbase9.apache.org,38061,1689325950049 in 220 msec 2023-07-14 09:12:42,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-14 09:12:42,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, ASSIGN in 390 msec 2023-07-14 09:12:42,959 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:12:42,960 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325962960"}]},"ts":"1689325962960"} 2023-07-14 09:12:42,962 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 09:12:42,966 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:12:42,972 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 09:12:42,977 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:42,979 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:42,983 DEBUG [hconnection-0x521a2523-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:42,987 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-14 09:12:42,997 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 09:12:43,039 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,039 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,039 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,039 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 09:12:43,039 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:12:43,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,050 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 09:12:43,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 810 msec 2023-07-14 09:12:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 09:12:43,374 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 09:12:43,374 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-14 09:12:43,375 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:43,380 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-14 09:12:43,381 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:43,381 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-14 09:12:43,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325963397 (current time:1689325963397). 2023-07-14 09:12:43,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:12:43,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa83a3f to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:43,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f5239, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:43,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,408 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa83a3f to 127.0.0.1:63612 2023-07-14 09:12:43,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:43,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x55a582b7 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:43,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@375f2600, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:43,419 DEBUG [hconnection-0xe2594d7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,420 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,432 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55a582b7 to 127.0.0.1:63612 2023-07-14 09:12:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 09:12:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:12:43,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,484 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,485 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689326563485 2023-07-14 09:12:43,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 09:12:43,488 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-07-14 09:12:43,491 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,492 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689326563492 2023-07-14 09:12:43,493 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:12:43,493 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:12:43,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,522 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 09:12:43,522 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,523 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 09:12:43,523 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 09:12:43,524 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,524 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,529 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,529 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,529 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,529 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,530 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,530 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,531 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,531 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,536 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,536 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,536 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,537 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,536 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,537 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,536 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,538 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,539 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,539 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,538 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,539 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,539 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,539 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,539 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,541 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,541 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,541 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,541 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,542 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,542 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,542 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,542 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,542 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,543 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,543 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb64a88[Count = 1] remaining members to acquire global barrier 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:43,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb64a88[Count = 0] remaining members to acquire global barrier 2023-07-14 09:12:43,548 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 09:12:43,548 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:43,551 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:43,551 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:12:43,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,551 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:43,552 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:43,552 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:43,552 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:43,553 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. started... 2023-07-14 09:12:43,553 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:43,554 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:43,554 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:43,554 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,554 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. started... 2023-07-14 09:12:43,554 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,554 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:12:43,558 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a58198bebb30fe26f13fb18a277e058e: 2023-07-14 09:12:43,558 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a78c2dcd76c9937c79c14e951bcbb187: 2023-07-14 09:12:43,560 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,560 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,561 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:43,561 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,562 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:43,567 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:43,567 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:43,571 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:12:43,571 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:12:43,590 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. completed. 2023-07-14 09:12:43,590 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:43,591 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:43,591 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:43,591 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,591 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:43,591 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:12:43,591 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. completed. 2023-07-14 09:12:43,592 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:43,592 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:43,592 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:43,592 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,592 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:43,592 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:12:43,593 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,593 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,593 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:43,593 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,593 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:43,594 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:43,595 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,594 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,595 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,599 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:12:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:12:43,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 09:12:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:12:43,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 09:12:43,605 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 09:12:43,605 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:12:43,605 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:12:43,605 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,605 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:12:43,608 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,608 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,608 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,608 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,608 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,609 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,609 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,609 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,610 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,611 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,616 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,617 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:43,618 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,634 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:43,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:43,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,636 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:43,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:43,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 09:12:43,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,749 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 09:12:43,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689325963486Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689325963636 (+150 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689325963636Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689325963650 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689325963671 (+21 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689325963748 (+77 ms) 2023-07-14 09:12:43,751 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 264 msec 2023-07-14 09:12:43,800 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:43,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:43,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:12:43,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42505] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:12:43,831 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,838 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:12:43,846 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 09:12:43,847 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:43,849 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:12:43,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325963880 (current time:1689325963880). 2023-07-14 09:12:43,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:12:43,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x3698fb70 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:43,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48ee3205, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:43,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,916 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3698fb70 to 127.0.0.1:63612 2023-07-14 09:12:43,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:43,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x433b49b2 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:12:43,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@328969de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:12:43,929 DEBUG [hconnection-0xbce0b90-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,933 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:12:43,940 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:12:43,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x433b49b2 to 127.0.0.1:63612 2023-07-14 09:12:43,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:12:43,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 09:12:43,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:12:43,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,946 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,947 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689326563947 2023-07-14 09:12:43,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 09:12:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 09:12:43,949 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:12:43,949 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:12:43,950 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 09:12:43,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-14 09:12:43,953 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:43,954 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689326563954 2023-07-14 09:12:43,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 09:12:43,980 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 09:12:43,980 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,982 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 09:12:43,982 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 09:12:43,983 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,983 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,985 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,985 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,985 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,985 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,986 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,986 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,986 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,987 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 09:12:43,988 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 09:12:43,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 09:12:43,988 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,988 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,988 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 09:12:43,989 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,989 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,989 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,989 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,989 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:12:43,991 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,991 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 09:12:43,991 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,991 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 09:12:43,991 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,991 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 09:12:43,993 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,993 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:43,994 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,995 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,996 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:12:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a63252c[Count = 1] remaining members to acquire global barrier 2023-07-14 09:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 09:12:44,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a63252c[Count = 0] remaining members to acquire global barrier 2023-07-14 09:12:44,004 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 09:12:44,004 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,012 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,012 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,012 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,013 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:44,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:44,013 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,013 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:44,013 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:44,013 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:12:44,013 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. started... 2023-07-14 09:12:44,013 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. started... 2023-07-14 09:12:44,013 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:12:44,014 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a58198bebb30fe26f13fb18a277e058e 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 09:12:44,014 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a78c2dcd76c9937c79c14e951bcbb187 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 09:12:44,017 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:44,017 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:44,017 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:44,049 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:44,051 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:12:44,109 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/.tmp/cf/3b70452c7d0c4321a1a0442925b00c52 2023-07-14 09:12:44,109 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/.tmp/cf/c61573d8385e41cb850e9a6e15071de5 2023-07-14 09:12:44,159 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/.tmp/cf/3b70452c7d0c4321a1a0442925b00c52 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf/3b70452c7d0c4321a1a0442925b00c52 2023-07-14 09:12:44,159 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/.tmp/cf/c61573d8385e41cb850e9a6e15071de5 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf/c61573d8385e41cb850e9a6e15071de5 2023-07-14 09:12:44,168 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf/c61573d8385e41cb850e9a6e15071de5, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 09:12:44,168 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf/3b70452c7d0c4321a1a0442925b00c52, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 09:12:44,173 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a78c2dcd76c9937c79c14e951bcbb187 in 159ms, sequenceid=6, compaction requested=false 2023-07-14 09:12:44,173 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 09:12:44,173 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a78c2dcd76c9937c79c14e951bcbb187: 2023-07-14 09:12:44,174 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:44,174 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:44,174 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf/3b70452c7d0c4321a1a0442925b00c52] hfiles 2023-07-14 09:12:44,174 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf/3b70452c7d0c4321a1a0442925b00c52 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:44,174 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a58198bebb30fe26f13fb18a277e058e in 160ms, sequenceid=6, compaction requested=false 2023-07-14 09:12:44,175 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a58198bebb30fe26f13fb18a277e058e: 2023-07-14 09:12:44,175 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:44,176 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:12:44,176 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf/c61573d8385e41cb850e9a6e15071de5] hfiles 2023-07-14 09:12:44,176 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf/c61573d8385e41cb850e9a6e15071de5 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 09:12:44,196 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. completed. 2023-07-14 09:12:44,196 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:12:44,196 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:44,196 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:44,196 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,196 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. completed. 2023-07-14 09:12:44,196 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:44,196 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:12:44,196 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:12:44,197 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:12:44,197 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:12:44,197 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,197 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 09:12:44,197 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:12:44,198 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:44,198 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:44,198 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 09:12:44,199 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,198 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:44,199 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,199 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:44,199 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 09:12:44,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:12:44,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 09:12:44,209 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 09:12:44,209 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:12:44,209 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:12:44,209 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 09:12:44,209 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:12:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:12:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:12:44,212 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:44,213 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,213 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:12:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,214 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:12:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 09:12:44,216 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,216 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,217 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:44,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:44,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:44,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:44,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:44,228 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:44,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 09:12:44,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:44,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:12:44,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 09:12:44,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:12:44,228 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:12:44,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:12:44,228 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:44,228 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:44,228 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:12:44,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:44,229 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:44,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:44,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:12:44,229 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:12:44,229 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:12:44,230 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,230 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:12:44,230 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:12:44,230 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,230 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,251 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:12:44,252 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:12:44,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 09:12:44,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,311 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 09:12:44,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689325963948Consolidate snapshot: snaptb0-testExportWithTargetName at 1689325964228 (+280 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689325964228Writing data manifest for snaptb0-testExportWithTargetName at 1689325964235 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689325964262 (+27 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689325964310 (+48 ms) 2023-07-14 09:12:44,314 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 09:12:44,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 366 msec 2023-07-14 09:12:44,552 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:12:44,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 09:12:44,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:12:44,556 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556 2023-07-14 09:12:44,557 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43917, tgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556, rawTgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:12:44,600 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:12:44,600 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2110200463_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 09:12:44,600 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 09:12:44,618 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 09:12:44,687 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,687 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,688 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,688 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,689 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,689 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,689 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,765 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-6907152437082094105.jar 2023-07-14 09:12:44,765 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,766 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,766 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,767 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,767 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,767 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:12:44,768 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:12:44,769 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:12:44,769 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:12:44,770 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:12:44,770 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:12:44,771 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:12:44,772 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:12:44,772 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:12:44,772 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:12:44,773 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:12:44,776 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:44,777 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:44,777 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:12:44,777 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:44,778 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:12:44,778 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:12:44,779 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:12:46,113 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:12:46,120 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 09:12:46,130 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 09:12:46,704 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:12:46,706 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:12:47,353 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0001_000001 (auth:SIMPLE) 2023-07-14 09:12:48,413 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:12:54,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0001_000001 (auth:SIMPLE) 2023-07-14 09:12:56,598 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0001_000001 (auth:SIMPLE) 2023-07-14 09:13:01,212 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0001_000001 (auth:SIMPLE) 2023-07-14 09:13:03,206 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:13:03,209 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:13:03,223 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 09:13:03,223 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:13:03,224 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:13:03,224 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 09:13:03,225 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 09:13:03,225 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 09:13:03,225 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556/.hbase-snapshot/testExportWithTargetName 2023-07-14 09:13:03,225 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 09:13:03,225 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325964556/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 09:13:03,236 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 09:13:03,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 09:13:03,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,258 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325983258"}]},"ts":"1689325983258"} 2023-07-14 09:13:03,262 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 09:13:03,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 09:13:03,265 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 09:13:03,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, UNASSIGN}] 2023-07-14 09:13:03,274 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, UNASSIGN 2023-07-14 09:13:03,276 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, UNASSIGN 2023-07-14 09:13:03,277 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a58198bebb30fe26f13fb18a277e058e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:03,277 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325983277"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325983277"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325983277"}]},"ts":"1689325983277"} 2023-07-14 09:13:03,279 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a78c2dcd76c9937c79c14e951bcbb187, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:03,279 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325983279"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325983279"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325983279"}]},"ts":"1689325983279"} 2023-07-14 09:13:03,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure a58198bebb30fe26f13fb18a277e058e, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:13:03,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure a78c2dcd76c9937c79c14e951bcbb187, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:13:03,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 09:13:03,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:13:03,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a58198bebb30fe26f13fb18a277e058e, disabling compactions & flushes 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a78c2dcd76c9937c79c14e951bcbb187, disabling compactions & flushes 2023-07-14 09:13:03,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:13:03,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. after waiting 0 ms 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. after waiting 0 ms 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:13:03,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:13:03,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:03,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:03,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e. 2023-07-14 09:13:03,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a58198bebb30fe26f13fb18a277e058e: 2023-07-14 09:13:03,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:13:03,474 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a58198bebb30fe26f13fb18a277e058e, regionState=CLOSED 2023-07-14 09:13:03,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325983474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983474"}]},"ts":"1689325983474"} 2023-07-14 09:13:03,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-14 09:13:03,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure a58198bebb30fe26f13fb18a277e058e, server=jenkins-hbase9.apache.org,42505,1689325949776 in 193 msec 2023-07-14 09:13:03,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a58198bebb30fe26f13fb18a277e058e, UNASSIGN in 216 msec 2023-07-14 09:13:03,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:03,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:03,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187. 2023-07-14 09:13:03,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a78c2dcd76c9937c79c14e951bcbb187: 2023-07-14 09:13:03,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:13:03,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a78c2dcd76c9937c79c14e951bcbb187, regionState=CLOSED 2023-07-14 09:13:03,496 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689325983496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983496"}]},"ts":"1689325983496"} 2023-07-14 09:13:03,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-14 09:13:03,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure a78c2dcd76c9937c79c14e951bcbb187, server=jenkins-hbase9.apache.org,38061,1689325950049 in 213 msec 2023-07-14 09:13:03,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-14 09:13:03,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a78c2dcd76c9937c79c14e951bcbb187, UNASSIGN in 235 msec 2023-07-14 09:13:03,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325983507"}]},"ts":"1689325983507"} 2023-07-14 09:13:03,509 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 09:13:03,511 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 09:13:03,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 269 msec 2023-07-14 09:13:03,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 09:13:03,568 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 09:13:03,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 09:13:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,587 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 09:13:03,589 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,592 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 09:13:03,597 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,597 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,598 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,598 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 09:13:03,598 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 09:13:03,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 09:13:03,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 09:13:03,602 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:13:03,602 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 09:13:03,605 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:03,606 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/recovered.edits] 2023-07-14 09:13:03,606 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/recovered.edits] 2023-07-14 09:13:03,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 09:13:03,616 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf/3b70452c7d0c4321a1a0442925b00c52 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/cf/3b70452c7d0c4321a1a0442925b00c52 2023-07-14 09:13:03,616 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf/c61573d8385e41cb850e9a6e15071de5 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/cf/c61573d8385e41cb850e9a6e15071de5 2023-07-14 09:13:03,620 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187/recovered.edits/9.seqid 2023-07-14 09:13:03,620 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e/recovered.edits/9.seqid 2023-07-14 09:13:03,621 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a78c2dcd76c9937c79c14e951bcbb187 2023-07-14 09:13:03,621 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportWithTargetName/a58198bebb30fe26f13fb18a277e058e 2023-07-14 09:13:03,622 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 09:13:03,625 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,645 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 09:13:03,649 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 09:13:03,651 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,651 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 09:13:03,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689325983651"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:03,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689325983651"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:03,653 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:13:03,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a58198bebb30fe26f13fb18a277e058e, NAME => 'testtb-testExportWithTargetName,,1689325962240.a58198bebb30fe26f13fb18a277e058e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a78c2dcd76c9937c79c14e951bcbb187, NAME => 'testtb-testExportWithTargetName,1,1689325962240.a78c2dcd76c9937c79c14e951bcbb187.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:13:03,654 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 09:13:03,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689325983654"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:03,656 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 09:13:03,658 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 09:13:03,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-07-14 09:13:03,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 09:13:03,711 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 09:13:03,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 09:13:03,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 09:13:03,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 09:13:03,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 09:13:03,809 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 707) Potentially hanging thread: hconnection-0x16882c96-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:45260 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_326298703_1 at /127.0.0.1:34326 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:40680 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_326298703_1 at /127.0.0.1:58594 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:35700 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:35193 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:36403 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:36333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=927 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=587 (was 672), ProcessCount=190 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1748 (was 3523) 2023-07-14 09:13:03,810 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-14 09:13:03,839 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=587, ProcessCount=190, AvailableMemoryMB=1747 2023-07-14 09:13:03,839 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-14 09:13:03,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:13:03,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:03,850 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:13:03,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 09:13:03,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:13:03,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:03,862 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 2023-07-14 09:13:03,863 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:03,863 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 empty. 2023-07-14 09:13:03,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 empty. 2023-07-14 09:13:03,865 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 2023-07-14 09:13:03,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:03,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 09:13:03,886 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 09:13:03,887 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 962e30e039736af3ae191000e2e97694, NAME => 'testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:13:03,888 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5970711e6b1c332c88ae81e11d9b6d14, NAME => 'testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:13:03,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:03,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5970711e6b1c332c88ae81e11d9b6d14, disabling compactions & flushes 2023-07-14 09:13:03,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:03,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:03,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. after waiting 0 ms 2023-07-14 09:13:03,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:03,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:03,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5970711e6b1c332c88ae81e11d9b6d14: 2023-07-14 09:13:03,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:03,910 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 962e30e039736af3ae191000e2e97694, disabling compactions & flushes 2023-07-14 09:13:03,910 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:03,910 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:03,910 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. after waiting 0 ms 2023-07-14 09:13:03,910 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:03,910 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:03,910 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 962e30e039736af3ae191000e2e97694: 2023-07-14 09:13:03,913 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:13:03,914 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983914"}]},"ts":"1689325983914"} 2023-07-14 09:13:03,914 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325983914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689325983914"}]},"ts":"1689325983914"} 2023-07-14 09:13:03,917 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:13:03,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:13:03,919 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325983919"}]},"ts":"1689325983919"} 2023-07-14 09:13:03,921 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 09:13:03,926 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:13:03,928 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:13:03,929 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:13:03,929 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:13:03,929 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:13:03,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, ASSIGN}] 2023-07-14 09:13:03,932 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, ASSIGN 2023-07-14 09:13:03,933 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, ASSIGN 2023-07-14 09:13:03,935 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:13:03,935 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41907,1689325949930; forceNewPlan=false, retain=false 2023-07-14 09:13:03,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:04,085 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:13:04,089 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=962e30e039736af3ae191000e2e97694, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,089 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5970711e6b1c332c88ae81e11d9b6d14, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,089 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325984089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325984089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325984089"}]},"ts":"1689325984089"} 2023-07-14 09:13:04,089 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325984089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689325984089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689325984089"}]},"ts":"1689325984089"} 2023-07-14 09:13:04,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 962e30e039736af3ae191000e2e97694, server=jenkins-hbase9.apache.org,41907,1689325949930}] 2023-07-14 09:13:04,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 5970711e6b1c332c88ae81e11d9b6d14, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:13:04,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:04,247 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,247 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:13:04,252 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:13:04,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:04,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5970711e6b1c332c88ae81e11d9b6d14, NAME => 'testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:13:04,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. service=AccessControlService 2023-07-14 09:13:04,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:04,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:04,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,257 INFO [StoreOpener-5970711e6b1c332c88ae81e11d9b6d14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 962e30e039736af3ae191000e2e97694, NAME => 'testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:13:04,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. service=AccessControlService 2023-07-14 09:13:04,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,259 DEBUG [StoreOpener-5970711e6b1c332c88ae81e11d9b6d14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf 2023-07-14 09:13:04,259 DEBUG [StoreOpener-5970711e6b1c332c88ae81e11d9b6d14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf 2023-07-14 09:13:04,260 INFO [StoreOpener-5970711e6b1c332c88ae81e11d9b6d14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5970711e6b1c332c88ae81e11d9b6d14 columnFamilyName cf 2023-07-14 09:13:04,260 INFO [StoreOpener-962e30e039736af3ae191000e2e97694-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,261 INFO [StoreOpener-5970711e6b1c332c88ae81e11d9b6d14-1] regionserver.HStore(310): Store=5970711e6b1c332c88ae81e11d9b6d14/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:04,263 DEBUG [StoreOpener-962e30e039736af3ae191000e2e97694-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf 2023-07-14 09:13:04,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,263 DEBUG [StoreOpener-962e30e039736af3ae191000e2e97694-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf 2023-07-14 09:13:04,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,264 INFO [StoreOpener-962e30e039736af3ae191000e2e97694-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 962e30e039736af3ae191000e2e97694 columnFamilyName cf 2023-07-14 09:13:04,264 INFO [StoreOpener-962e30e039736af3ae191000e2e97694-1] regionserver.HStore(310): Store=962e30e039736af3ae191000e2e97694/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:04,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:04,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:04,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:04,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5970711e6b1c332c88ae81e11d9b6d14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61472593, jitterRate=-0.08398698270320892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:04,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5970711e6b1c332c88ae81e11d9b6d14: 2023-07-14 09:13:04,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14., pid=31, masterSystemTime=1689325984247 2023-07-14 09:13:04,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:04,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 962e30e039736af3ae191000e2e97694; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59616492, jitterRate=-0.11164504289627075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:04,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 962e30e039736af3ae191000e2e97694: 2023-07-14 09:13:04,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:04,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:04,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694., pid=30, masterSystemTime=1689325984247 2023-07-14 09:13:04,279 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5970711e6b1c332c88ae81e11d9b6d14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,280 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325984279"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325984279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325984279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325984279"}]},"ts":"1689325984279"} 2023-07-14 09:13:04,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:04,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:04,286 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=962e30e039736af3ae191000e2e97694, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,288 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689325984286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689325984286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689325984286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689325984286"}]},"ts":"1689325984286"} 2023-07-14 09:13:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-14 09:13:04,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 5970711e6b1c332c88ae81e11d9b6d14, server=jenkins-hbase9.apache.org,38061,1689325950049 in 190 msec 2023-07-14 09:13:04,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, ASSIGN in 361 msec 2023-07-14 09:13:04,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-14 09:13:04,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 962e30e039736af3ae191000e2e97694, server=jenkins-hbase9.apache.org,41907,1689325949930 in 197 msec 2023-07-14 09:13:04,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-14 09:13:04,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, ASSIGN in 364 msec 2023-07-14 09:13:04,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:13:04,298 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689325984297"}]},"ts":"1689325984297"} 2023-07-14 09:13:04,299 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 09:13:04,302 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:13:04,302 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 09:13:04,304 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:13:04,305 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:04,305 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:04,305 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:04,305 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:04,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:04,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:04,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:04,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:04,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 464 msec 2023-07-14 09:13:04,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 09:13:04,459 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 09:13:04,459 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 09:13:04,460 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:04,465 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 09:13:04,466 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:04,466 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-14 09:13:04,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325984475 (current time:1689325984475). 2023-07-14 09:13:04,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:04,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x551440fb to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:04,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dc0a46c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:04,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,504 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x551440fb to 127.0.0.1:63612 2023-07-14 09:13:04,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:04,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x0f690b5f to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:04,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788d81d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:04,538 DEBUG [hconnection-0x1006b968-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,542 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:04,548 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:04,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f690b5f to 127.0.0.1:63612 2023-07-14 09:13:04,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:04,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:13:04,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:04,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,559 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,570 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326584570 2023-07-14 09:13:04,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 09:13:04,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:04,572 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:04,572 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:04,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,574 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:04,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 21 msec 2023-07-14 09:13:04,577 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,578 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326584578 2023-07-14 09:13:04,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,602 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 09:13:04,602 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,605 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 09:13:04,605 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:13:04,655 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,655 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,658 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,658 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,658 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,658 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,658 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,659 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,659 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,659 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,660 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,660 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,660 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,662 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,660 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:04,662 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,662 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,662 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,662 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:04,664 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,664 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:04,664 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,664 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:04,664 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,664 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:04,665 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,671 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,672 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,672 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,672 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,672 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,672 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,672 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,672 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:04,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,674 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:04,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7115ec[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:04,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7115ec[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:04,679 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:13:04,679 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,682 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:13:04,683 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:04,682 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:04,683 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,683 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:04,683 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:04,683 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:04,683 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. started... 2023-07-14 09:13:04,684 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,684 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,684 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,687 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:04,687 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:04,687 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5970711e6b1c332c88ae81e11d9b6d14: 2023-07-14 09:13:04,687 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:04,687 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. started... 2023-07-14 09:13:04,688 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,688 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:04,688 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:04,689 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 962e30e039736af3ae191000e2e97694: 2023-07-14 09:13:04,690 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,690 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:04,690 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:04,739 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. completed. 2023-07-14 09:13:04,740 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:04,740 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:04,740 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:04,740 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,740 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,740 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:13:04,743 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,743 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,743 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,744 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,748 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. completed. 2023-07-14 09:13:04,748 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:04,748 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:04,748 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:04,749 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,749 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:04,749 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:13:04,751 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:04,751 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,751 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,751 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:13:04,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:13:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,41907,1689325949930': 2023-07-14 09:13:04,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:13:04,774 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 09:13:04,774 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:04,774 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:04,774 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,774 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:04,782 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:04,782 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,783 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,782 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:04,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,783 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,785 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:04,785 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:04,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,788 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,790 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,790 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,795 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,795 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,795 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,795 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,795 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:04,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:04,796 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:04,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,796 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:04,799 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,799 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:04,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,874 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:04,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:04,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:04,879 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:13:04,907 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 09:13:04,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,908 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:04,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689325984570Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689325984798 (+228 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689325984799 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689325984816 (+17 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689325984850 (+34 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689325984907 (+57 ms) 2023-07-14 09:13:04,912 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:04,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 340 msec 2023-07-14 09:13:05,179 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:05,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:05,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:05,190 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:05,196 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:05,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:05,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41907] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:05,202 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 09:13:05,202 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:05,203 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:05,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:05,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689325985226 (current time:1689325985226). 2023-07-14 09:13:05,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:05,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x39795f9b to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:05,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6705d01c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:05,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:05,251 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:05,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39795f9b to 127.0.0.1:63612 2023-07-14 09:13:05,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:05,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x4fe4557b to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:05,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755eec35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:05,357 DEBUG [hconnection-0x1c0f019a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:05,359 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:05,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:05,372 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fe4557b to 127.0.0.1:63612 2023-07-14 09:13:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:05,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:13:05,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:05,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:05,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:05,383 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:05,384 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326585384 2023-07-14 09:13:05,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:13:05,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 09:13:05,386 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:05,386 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:05,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:05,389 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:13:05,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-14 09:13:05,392 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:05,393 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326585393 2023-07-14 09:13:05,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 09:13:05,414 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 09:13:05,414 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:05,415 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 09:13:05,415 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:13:05,416 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,416 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,417 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:05,417 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:05,417 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:05,417 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:05,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:05,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:05,418 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,418 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,418 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,418 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 09:13:05,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 09:13:05,420 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:05,420 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:05,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 09:13:05,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 09:13:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 09:13:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:05,424 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:05,424 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:05,424 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:05,424 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:05,423 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:05,425 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:05,426 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 09:13:05,426 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 09:13:05,426 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 09:13:05,428 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:05,428 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,430 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,430 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,430 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:05,430 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,430 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,431 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,431 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:05,432 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,432 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4188ff95[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:05,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 09:13:05,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4188ff95[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:05,439 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:13:05,439 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:05,441 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,441 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:05,442 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:13:05,441 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:05,442 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:05,442 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:13:05,442 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:05,442 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. started... 2023-07-14 09:13:05,442 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5970711e6b1c332c88ae81e11d9b6d14 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 09:13:05,442 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,442 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:05,442 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:05,443 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:05,443 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:05,443 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. started... 2023-07-14 09:13:05,443 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 962e30e039736af3ae191000e2e97694 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 09:13:05,443 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:05,443 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:05,443 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:05,486 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:05,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:05,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:05,488 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:05,490 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/.tmp/cf/30c086a7b66a4307a76bc17976916f20 2023-07-14 09:13:05,499 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/.tmp/cf/93f794c3e43443829af8da7381d3453f 2023-07-14 09:13:05,503 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/.tmp/cf/30c086a7b66a4307a76bc17976916f20 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf/30c086a7b66a4307a76bc17976916f20 2023-07-14 09:13:05,518 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/.tmp/cf/93f794c3e43443829af8da7381d3453f as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf/93f794c3e43443829af8da7381d3453f 2023-07-14 09:13:05,519 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf/30c086a7b66a4307a76bc17976916f20, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 09:13:05,522 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 5970711e6b1c332c88ae81e11d9b6d14 in 80ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:05,522 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 09:13:05,523 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5970711e6b1c332c88ae81e11d9b6d14: 2023-07-14 09:13:05,523 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:05,523 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:05,523 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf/30c086a7b66a4307a76bc17976916f20] hfiles 2023-07-14 09:13:05,523 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf/30c086a7b66a4307a76bc17976916f20 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:05,545 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf/93f794c3e43443829af8da7381d3453f, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 09:13:05,562 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 962e30e039736af3ae191000e2e97694 in 119ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:05,579 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 962e30e039736af3ae191000e2e97694: 2023-07-14 09:13:05,580 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:05,580 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:05,580 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf/93f794c3e43443829af8da7381d3453f] hfiles 2023-07-14 09:13:05,580 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf/93f794c3e43443829af8da7381d3453f for snapshot=snaptb0-testExportFileSystemState 2023-07-14 09:13:05,618 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. completed. 2023-07-14 09:13:05,618 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:05,618 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:05,618 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:05,618 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,642 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:05,642 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:13:05,649 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:05,649 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,649 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:05,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:05,649 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:05,651 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. completed. 2023-07-14 09:13:05,651 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:05,651 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:05,652 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:05,652 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,652 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 09:13:05,652 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:13:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,653 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,653 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 09:13:05,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,653 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:05,654 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 09:13:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:13:05,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:13:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,41907,1689325949930': 2023-07-14 09:13:05,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:13:05,666 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 09:13:05,666 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:05,666 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:05,666 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 09:13:05,666 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:05,670 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:05,670 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,671 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:05,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,670 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:05,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:05,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:05,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,672 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,673 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:05,673 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 09:13:05,676 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,676 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,676 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:05,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:05,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,682 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:05,683 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:05,683 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:05,683 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:05,683 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:05,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:05,683 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:05,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:05,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,685 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:05,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 09:13:05,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 09:13:05,688 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:05,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:05,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:05,690 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:13:05,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:05,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 09:13:05,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,818 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:05,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689325985384Consolidate snapshot: snaptb0-testExportFileSystemState at 1689325985685 (+301 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689325985685Writing data manifest for snaptb0-testExportFileSystemState at 1689325985710 (+25 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689325985747 (+37 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689325985817 (+70 ms) 2023-07-14 09:13:05,821 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 09:13:05,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 435 msec 2023-07-14 09:13:05,990 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:05,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:13:05,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:05,993 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993 2023-07-14 09:13:05,993 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43917, tgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993, rawTgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:13:06,022 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:13:06,023 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1493069972_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:06,023 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 09:13:06,046 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 09:13:06,512 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,513 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,514 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,514 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,515 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,515 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,516 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,617 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-6021450090526959769.jar 2023-07-14 09:13:06,617 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,618 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,618 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,619 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,619 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,620 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:06,620 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:13:06,621 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:13:06,621 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:13:06,622 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:13:06,622 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:13:06,623 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:13:06,623 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:13:06,624 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:13:06,624 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:13:06,625 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:13:06,625 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:06,626 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:06,626 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:06,627 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:06,627 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:06,627 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:06,628 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:07,373 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0001_000001 (auth:SIMPLE) 2023-07-14 09:13:07,869 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:13:07,873 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 09:13:07,876 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 09:13:07,991 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:07,991 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:08,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:09,106 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:13:14,170 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:16,473 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:21,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:23,158 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:13:23,161 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:13:23,172 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 09:13:23,172 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:13:23,173 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:13:23,173 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 09:13:23,174 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 09:13:23,174 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 09:13:23,174 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 09:13:23,175 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 09:13:23,175 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689325985993/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 09:13:23,182 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 09:13:23,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 09:13:23,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 09:13:23,188 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326003188"}]},"ts":"1689326003188"} 2023-07-14 09:13:23,190 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 09:13:23,236 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 09:13:23,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, UNASSIGN}] 2023-07-14 09:13:23,240 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, UNASSIGN 2023-07-14 09:13:23,240 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, UNASSIGN 2023-07-14 09:13:23,241 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=962e30e039736af3ae191000e2e97694, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:23,241 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5970711e6b1c332c88ae81e11d9b6d14, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:23,242 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326003241"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326003241"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326003241"}]},"ts":"1689326003241"} 2023-07-14 09:13:23,242 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326003241"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326003241"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326003241"}]},"ts":"1689326003241"} 2023-07-14 09:13:23,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 962e30e039736af3ae191000e2e97694, server=jenkins-hbase9.apache.org,41907,1689325949930}] 2023-07-14 09:13:23,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 5970711e6b1c332c88ae81e11d9b6d14, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:13:23,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 09:13:23,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:23,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 962e30e039736af3ae191000e2e97694, disabling compactions & flushes 2023-07-14 09:13:23,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:23,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:23,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. after waiting 0 ms 2023-07-14 09:13:23,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:23,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:23,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5970711e6b1c332c88ae81e11d9b6d14, disabling compactions & flushes 2023-07-14 09:13:23,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:23,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:23,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. after waiting 0 ms 2023-07-14 09:13:23,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:23,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:23,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:23,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694. 2023-07-14 09:13:23,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 962e30e039736af3ae191000e2e97694: 2023-07-14 09:13:23,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 962e30e039736af3ae191000e2e97694 2023-07-14 09:13:23,433 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=962e30e039736af3ae191000e2e97694, regionState=CLOSED 2023-07-14 09:13:23,434 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326003433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326003433"}]},"ts":"1689326003433"} 2023-07-14 09:13:23,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:13:23,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-14 09:13:23,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 962e30e039736af3ae191000e2e97694, server=jenkins-hbase9.apache.org,41907,1689325949930 in 191 msec 2023-07-14 09:13:23,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:13:23,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14. 2023-07-14 09:13:23,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5970711e6b1c332c88ae81e11d9b6d14: 2023-07-14 09:13:23,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=962e30e039736af3ae191000e2e97694, UNASSIGN in 200 msec 2023-07-14 09:13:23,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:23,445 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5970711e6b1c332c88ae81e11d9b6d14, regionState=CLOSED 2023-07-14 09:13:23,446 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689326003445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326003445"}]},"ts":"1689326003445"} 2023-07-14 09:13:23,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-14 09:13:23,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 5970711e6b1c332c88ae81e11d9b6d14, server=jenkins-hbase9.apache.org,38061,1689325950049 in 204 msec 2023-07-14 09:13:23,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 09:13:23,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5970711e6b1c332c88ae81e11d9b6d14, UNASSIGN in 214 msec 2023-07-14 09:13:23,457 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326003457"}]},"ts":"1689326003457"} 2023-07-14 09:13:23,458 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 09:13:23,460 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 09:13:23,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 279 msec 2023-07-14 09:13:23,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 09:13:23,491 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 09:13:23,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 09:13:23,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,497 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 09:13:23,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,501 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 09:13:23,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,504 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,504 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:23,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:23,505 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 09:13:23,507 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-14 09:13:23,508 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:13:23,508 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,508 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,508 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,509 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,509 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 09:13:23,509 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:23,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 09:13:23,512 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 2023-07-14 09:13:23,513 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:23,515 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/recovered.edits] 2023-07-14 09:13:23,516 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/recovered.edits] 2023-07-14 09:13:23,521 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf/30c086a7b66a4307a76bc17976916f20 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/cf/30c086a7b66a4307a76bc17976916f20 2023-07-14 09:13:23,522 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf/93f794c3e43443829af8da7381d3453f to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/cf/93f794c3e43443829af8da7381d3453f 2023-07-14 09:13:23,529 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14/recovered.edits/9.seqid 2023-07-14 09:13:23,530 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/5970711e6b1c332c88ae81e11d9b6d14 2023-07-14 09:13:23,531 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694/recovered.edits/9.seqid 2023-07-14 09:13:23,533 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemState/962e30e039736af3ae191000e2e97694 2023-07-14 09:13:23,533 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 09:13:23,537 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,540 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 09:13:23,543 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 09:13:23,547 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,547 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 09:13:23,547 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326003547"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:23,547 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326003547"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:23,551 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:13:23,551 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 962e30e039736af3ae191000e2e97694, NAME => 'testtb-testExportFileSystemState,,1689325983841.962e30e039736af3ae191000e2e97694.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5970711e6b1c332c88ae81e11d9b6d14, NAME => 'testtb-testExportFileSystemState,1,1689325983841.5970711e6b1c332c88ae81e11d9b6d14.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:13:23,551 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 09:13:23,551 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326003551"}]},"ts":"9223372036854775807"} 2023-07-14 09:13:23,555 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 09:13:23,559 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 09:13:23,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 67 msec 2023-07-14 09:13:23,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 09:13:23,612 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 09:13:23,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 09:13:23,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 09:13:23,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 09:13:23,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 09:13:23,693 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=767 (was 756) Potentially hanging thread: hconnection-0x16882c96-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:40124 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1640724519_1 at /127.0.0.1:54442 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1640724519_1 at /127.0.0.1:48358 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:36253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:36026 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2070 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:45963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=935 (was 927) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=691 (was 587) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 190), AvailableMemoryMB=1323 (was 1747) 2023-07-14 09:13:23,693 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-14 09:13:23,724 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=935, MaxFileDescriptor=60000, SystemLoadAverage=691, ProcessCount=190, AvailableMemoryMB=1323 2023-07-14 09:13:23,724 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-14 09:13:23,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:13:23,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:13:23,732 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:13:23,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 09:13:23,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:23,739 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:13:23,742 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:23,742 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:23,743 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a empty. 2023-07-14 09:13:23,743 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d empty. 2023-07-14 09:13:23,743 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:23,743 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:23,743 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 09:13:23,774 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 09:13:23,776 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a8d06b27805b38e6244d8842031a7c9a, NAME => 'testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:13:23,776 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1d375b87d8509ee5fcb2cb6b25d277d, NAME => 'testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:13:23,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:23,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:23,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a8d06b27805b38e6244d8842031a7c9a, disabling compactions & flushes 2023-07-14 09:13:23,801 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b1d375b87d8509ee5fcb2cb6b25d277d, disabling compactions & flushes 2023-07-14 09:13:23,801 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:23,801 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. after waiting 0 ms 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:23,802 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a8d06b27805b38e6244d8842031a7c9a: 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. after waiting 0 ms 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:23,802 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:23,802 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b1d375b87d8509ee5fcb2cb6b25d277d: 2023-07-14 09:13:23,805 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:13:23,806 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326003806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326003806"}]},"ts":"1689326003806"} 2023-07-14 09:13:23,807 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326003806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326003806"}]},"ts":"1689326003806"} 2023-07-14 09:13:23,809 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:13:23,810 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:13:23,810 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326003810"}]},"ts":"1689326003810"} 2023-07-14 09:13:23,812 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 09:13:23,817 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:13:23,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:13:23,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:13:23,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:13:23,818 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:13:23,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, ASSIGN}] 2023-07-14 09:13:23,822 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, ASSIGN 2023-07-14 09:13:23,822 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, ASSIGN 2023-07-14 09:13:23,823 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:13:23,823 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41907,1689325949930; forceNewPlan=false, retain=false 2023-07-14 09:13:23,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:23,973 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:13:23,976 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b1d375b87d8509ee5fcb2cb6b25d277d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:23,976 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326003976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326003976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326003976"}]},"ts":"1689326003976"} 2023-07-14 09:13:23,977 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a8d06b27805b38e6244d8842031a7c9a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:23,978 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326003977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326003977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326003977"}]},"ts":"1689326003977"} 2023-07-14 09:13:23,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure b1d375b87d8509ee5fcb2cb6b25d277d, server=jenkins-hbase9.apache.org,41907,1689325949930}] 2023-07-14 09:13:23,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure a8d06b27805b38e6244d8842031a7c9a, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:13:24,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:24,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1d375b87d8509ee5fcb2cb6b25d277d, NAME => 'testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:13:24,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. service=AccessControlService 2023-07-14 09:13:24,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:24,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8d06b27805b38e6244d8842031a7c9a, NAME => 'testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:13:24,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. service=AccessControlService 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:24,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,143 INFO [StoreOpener-b1d375b87d8509ee5fcb2cb6b25d277d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,143 INFO [StoreOpener-a8d06b27805b38e6244d8842031a7c9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,144 DEBUG [StoreOpener-b1d375b87d8509ee5fcb2cb6b25d277d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf 2023-07-14 09:13:24,144 DEBUG [StoreOpener-b1d375b87d8509ee5fcb2cb6b25d277d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf 2023-07-14 09:13:24,145 DEBUG [StoreOpener-a8d06b27805b38e6244d8842031a7c9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf 2023-07-14 09:13:24,145 DEBUG [StoreOpener-a8d06b27805b38e6244d8842031a7c9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf 2023-07-14 09:13:24,145 INFO [StoreOpener-b1d375b87d8509ee5fcb2cb6b25d277d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1d375b87d8509ee5fcb2cb6b25d277d columnFamilyName cf 2023-07-14 09:13:24,145 INFO [StoreOpener-a8d06b27805b38e6244d8842031a7c9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8d06b27805b38e6244d8842031a7c9a columnFamilyName cf 2023-07-14 09:13:24,146 INFO [StoreOpener-b1d375b87d8509ee5fcb2cb6b25d277d-1] regionserver.HStore(310): Store=b1d375b87d8509ee5fcb2cb6b25d277d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:24,146 INFO [StoreOpener-a8d06b27805b38e6244d8842031a7c9a-1] regionserver.HStore(310): Store=a8d06b27805b38e6244d8842031a7c9a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:13:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:13:24,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:13:24,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:24,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a8d06b27805b38e6244d8842031a7c9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59886747, jitterRate=-0.10761792957782745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:24,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a8d06b27805b38e6244d8842031a7c9a: 2023-07-14 09:13:24,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a., pid=46, masterSystemTime=1689326004132 2023-07-14 09:13:24,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:24,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:24,169 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a8d06b27805b38e6244d8842031a7c9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,169 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326004169"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326004169"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326004169"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326004169"}]},"ts":"1689326004169"} 2023-07-14 09:13:24,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-14 09:13:24,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure a8d06b27805b38e6244d8842031a7c9a, server=jenkins-hbase9.apache.org,38061,1689325950049 in 192 msec 2023-07-14 09:13:24,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:13:24,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b1d375b87d8509ee5fcb2cb6b25d277d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70584277, jitterRate=0.051787689328193665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:13:24,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b1d375b87d8509ee5fcb2cb6b25d277d: 2023-07-14 09:13:24,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, ASSIGN in 357 msec 2023-07-14 09:13:24,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d., pid=45, masterSystemTime=1689326004131 2023-07-14 09:13:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,190 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b1d375b87d8509ee5fcb2cb6b25d277d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,190 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326004189"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326004189"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326004189"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326004189"}]},"ts":"1689326004189"} 2023-07-14 09:13:24,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-14 09:13:24,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure b1d375b87d8509ee5fcb2cb6b25d277d, server=jenkins-hbase9.apache.org,41907,1689325949930 in 213 msec 2023-07-14 09:13:24,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-14 09:13:24,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, ASSIGN in 377 msec 2023-07-14 09:13:24,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:13:24,215 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326004215"}]},"ts":"1689326004215"} 2023-07-14 09:13:24,217 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 09:13:24,221 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:13:24,222 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 09:13:24,225 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 09:13:24,226 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:24,226 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:24,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:24,227 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:13:24,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:24,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:24,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:24,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 09:13:24,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 501 msec 2023-07-14 09:13:24,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 09:13:24,339 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 09:13:24,339 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-14 09:13:24,339 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:24,343 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-14 09:13:24,343 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:24,343 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-14 09:13:24,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326004346 (current time:1689326004346). 2023-07-14 09:13:24,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:24,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x09b901a6 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:24,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f97fcc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:24,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,357 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09b901a6 to 127.0.0.1:63612 2023-07-14 09:13:24,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:24,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x50467ab6 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:24,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11b3e529, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:24,367 DEBUG [hconnection-0x290cefcc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,370 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,376 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50467ab6 to 127.0.0.1:63612 2023-07-14 09:13:24,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:24,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 09:13:24,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:24,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,381 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,382 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689326604382 2023-07-14 09:13:24,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,382 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 09:13:24,383 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:24,383 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:24,385 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-14 09:13:24,388 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,389 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689326604389 2023-07-14 09:13:24,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,417 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 09:13:24,418 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,419 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 09:13:24,419 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 09:13:24,420 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,420 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,421 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,421 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,421 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,421 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,421 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,422 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,422 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,422 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:24,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,423 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,423 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,425 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,425 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,425 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,425 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,427 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,427 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,425 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,427 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,427 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,427 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,430 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,430 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,430 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,433 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,433 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,433 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,433 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,434 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7281d82d[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:24,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7281d82d[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:24,439 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 09:13:24,439 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,440 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,440 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,440 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,440 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:24,441 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:24,441 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:24,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,441 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,441 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,441 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. started... 2023-07-14 09:13:24,441 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:13:24,441 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:24,442 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:24,442 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:24,442 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. started... 2023-07-14 09:13:24,442 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1d375b87d8509ee5fcb2cb6b25d277d: 2023-07-14 09:13:24,442 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,443 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a8d06b27805b38e6244d8842031a7c9a: 2023-07-14 09:13:24,443 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:24,443 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,444 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:24,444 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:24,444 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,444 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:24,444 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:13:24,448 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:24,448 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,448 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:24,483 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:24,484 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. completed. 2023-07-14 09:13:24,484 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:24,484 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:24,484 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:24,484 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,484 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:24,484 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:13:24,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:24,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:24,485 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:24,485 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. completed. 2023-07-14 09:13:24,486 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,486 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:24,486 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:24,486 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,486 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:24,486 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:13:24,487 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,487 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:24,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,487 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,488 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:24,489 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:24,489 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,489 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:24,489 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:13:24,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 09:13:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,41907,1689325949930': 2023-07-14 09:13:24,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 09:13:24,500 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 09:13:24,500 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:24,500 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:24,500 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,500 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:24,502 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,502 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,502 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:24,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,502 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,502 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:24,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,503 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:24,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:24,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:24,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,507 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,510 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,514 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,514 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,515 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,521 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,522 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,522 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,522 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,522 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:24,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:24,522 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:24,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:24,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 09:13:24,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,604 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 09:13:24,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689326004382Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689326004524 (+142 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689326004524Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689326004528 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689326004550 (+22 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689326004604 (+54 ms) 2023-07-14 09:13:24,609 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 226 msec 2023-07-14 09:13:24,685 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:24,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:24,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:24,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41907] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:24,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:13:24,716 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 09:13:24,716 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,716 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:13:24,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326004744 (current time:1689326004744). 2023-07-14 09:13:24,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:13:24,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x3b750151 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b68ec1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:24,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,779 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b750151 to 127.0.0.1:63612 2023-07-14 09:13:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:24,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x0293bc37 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:13:24,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ff4abd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:13:24,846 DEBUG [hconnection-0x7d1b5489-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,855 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:13:24,863 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:13:24,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0293bc37 to 127.0.0.1:63612 2023-07-14 09:13:24,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:13:24,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 09:13:24,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:13:24,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,871 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,872 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689326604872 2023-07-14 09:13:24,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 09:13:24,873 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 09:13:24,877 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:13:24,877 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:13:24,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,878 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 09:13:24,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-14 09:13:24,883 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:24,892 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689326604892 2023-07-14 09:13:24,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 09:13:24,928 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 09:13:24,928 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,930 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 09:13:24,930 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 09:13:24,968 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,968 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,971 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,971 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,971 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,971 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:24,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:24,972 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,972 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,972 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,972 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:13:24,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 09:13:24,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 09:13:24,973 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,973 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 09:13:24,974 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,974 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 09:13:24,974 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 09:13:24,974 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:13:24,977 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:24,979 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,979 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,979 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,980 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,980 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,980 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,980 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 09:13:24,980 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 09:13:24,980 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 09:13:24,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:24,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:24,980 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:13:24,981 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,982 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,982 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,982 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,982 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,982 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,982 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,983 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,983 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,983 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,983 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:13:24,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:24,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a5d9f9c[Count = 1] remaining members to acquire global barrier 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:24,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 09:13:24,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a5d9f9c[Count = 0] remaining members to acquire global barrier 2023-07-14 09:13:24,992 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 09:13:24,992 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,993 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,993 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,994 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:24,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,994 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:24,994 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:24,994 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:24,994 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:24,994 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:24,994 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. started... 2023-07-14 09:13:24,994 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:13:24,994 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 09:13:24,994 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:24,994 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:13:24,994 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1d375b87d8509ee5fcb2cb6b25d277d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 09:13:24,997 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:13:24,998 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:13:24,998 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:24,998 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. started... 2023-07-14 09:13:24,998 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:24,998 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:24,998 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:25,000 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a8d06b27805b38e6244d8842031a7c9a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 09:13:25,048 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/.tmp/cf/1a88c04ef14c4758ab210e11d4aa703f 2023-07-14 09:13:25,053 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/.tmp/cf/9a9c8186f8274a3c80506ef3ff4da009 2023-07-14 09:13:25,057 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/.tmp/cf/1a88c04ef14c4758ab210e11d4aa703f as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf/1a88c04ef14c4758ab210e11d4aa703f 2023-07-14 09:13:25,063 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/.tmp/cf/9a9c8186f8274a3c80506ef3ff4da009 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf/9a9c8186f8274a3c80506ef3ff4da009 2023-07-14 09:13:25,066 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf/1a88c04ef14c4758ab210e11d4aa703f, entries=47, sequenceid=6, filesize=8 K 2023-07-14 09:13:25,067 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a8d06b27805b38e6244d8842031a7c9a in 69ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:25,067 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 09:13:25,068 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a8d06b27805b38e6244d8842031a7c9a: 2023-07-14 09:13:25,068 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,068 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:25,068 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf/1a88c04ef14c4758ab210e11d4aa703f] hfiles 2023-07-14 09:13:25,068 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf/1a88c04ef14c4758ab210e11d4aa703f for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,069 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf/9a9c8186f8274a3c80506ef3ff4da009, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 09:13:25,070 INFO [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b1d375b87d8509ee5fcb2cb6b25d277d in 76ms, sequenceid=6, compaction requested=false 2023-07-14 09:13:25,072 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1d375b87d8509ee5fcb2cb6b25d277d: 2023-07-14 09:13:25,072 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,072 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:13:25,072 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf/9a9c8186f8274a3c80506ef3ff4da009] hfiles 2023-07-14 09:13:25,072 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf/9a9c8186f8274a3c80506ef3ff4da009 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 09:13:25,106 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. completed. 2023-07-14 09:13:25,106 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:13:25,106 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:25,106 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:25,106 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,106 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:25,106 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:13:25,108 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:25,108 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,108 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:25,108 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:25,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:13:25,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 09:13:25,128 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. completed. 2023-07-14 09:13:25,128 DEBUG [rs(jenkins-hbase9.apache.org,41907,1689325949930)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:13:25,128 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:13:25,128 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:13:25,128 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,128 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 09:13:25,128 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:13:25,130 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,130 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 09:13:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:25,130 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:25,130 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 09:13:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,41907,1689325949930': 2023-07-14 09:13:25,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 09:13:25,136 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 09:13:25,136 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:13:25,136 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:13:25,136 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 09:13:25,136 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:13:25,138 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,138 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,139 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:13:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:13:25,138 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,140 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:13:25,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,141 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:13:25,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,144 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,144 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:13:25,145 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 09:13:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:25,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,153 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:13:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,155 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,155 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,155 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,155 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:13:25,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:25,155 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 09:13:25,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:13:25,153 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:13:25,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:13:25,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 09:13:25,156 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:13:25,156 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:13:25,156 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,156 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:13:25,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:13:25,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,181 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:25,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:25,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:13:25,182 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:13:25,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,212 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 09:13:25,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,215 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689326004873Consolidate snapshot: snaptb0-testConsecutiveExports at 1689326005156 (+283 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689326005156Writing data manifest for snaptb0-testConsecutiveExports at 1689326005160 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689326005178 (+18 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689326005212 (+34 ms) 2023-07-14 09:13:25,220 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 09:13:25,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 347 msec 2023-07-14 09:13:25,483 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:13:25,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 09:13:25,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:13:25,484 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484 2023-07-14 09:13:25,485 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:13:25,510 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:13:25,510 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@53df5299, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,510 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 09:13:25,520 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:25,536 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,537 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,537 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,538 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,538 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,538 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,539 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,613 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-4653405825076642063.jar 2023-07-14 09:13:25,614 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,614 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,615 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,615 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,615 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,616 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:25,616 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:13:25,617 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:13:25,617 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:13:25,617 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:13:25,618 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:13:25,618 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:13:25,618 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:13:25,619 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:13:25,619 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:13:25,620 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:13:25,620 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:25,620 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:25,621 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:25,621 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:25,621 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:25,621 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:25,622 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:26,180 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:13:26,183 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 09:13:26,185 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 09:13:27,374 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:27,374 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:27,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0002_000001 (auth:SIMPLE) 2023-07-14 09:13:28,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:29,048 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:13:33,553 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:35,852 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:39,466 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:41,444 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:13:41,444 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:13:41,450 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 09:13:41,450 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:13:41,451 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:13:41,451 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,456 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:13:41,456 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:13:41,457 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5516e1e2 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,457 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:13:41,457 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:13:41,459 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:13:41,500 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:13:41,500 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6da7cc11, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,500 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 09:13:41,527 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 09:13:41,552 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,552 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,553 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,553 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,554 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,555 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,555 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,657 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-8764603643366498636.jar 2023-07-14 09:13:41,659 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,660 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,660 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,661 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,661 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,662 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:13:41,663 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:13:41,663 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:13:41,664 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:13:41,664 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:13:41,665 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:13:41,666 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:13:41,666 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:13:41,666 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:13:41,667 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:13:41,668 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:13:41,668 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:41,669 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:41,669 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:41,670 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:41,670 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:13:41,670 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:41,671 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:13:43,541 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:13:43,546 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 09:13:43,549 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 09:13:45,623 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:45,623 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:13:45,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0003_000001 (auth:SIMPLE) 2023-07-14 09:13:46,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0004_000001 (auth:SIMPLE) 2023-07-14 09:13:53,834 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0004_000001 (auth:SIMPLE) 2023-07-14 09:13:56,314 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0004_000001 (auth:SIMPLE) 2023-07-14 09:14:02,335 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:14:02,335 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:14:02,370 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 09:14:02,371 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:14:02,371 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:14:02,371 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:14:02,372 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:14:02,372 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:14:02,372 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5516e1e2 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 09:14:02,373 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 09:14:02,373 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/local-export-1689326005484/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 09:14:02,393 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 09:14:02,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 09:14:02,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:02,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:02,404 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326042404"}]},"ts":"1689326042404"} 2023-07-14 09:14:02,407 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 09:14:02,410 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 09:14:02,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, UNASSIGN}] 2023-07-14 09:14:02,413 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, UNASSIGN 2023-07-14 09:14:02,415 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, UNASSIGN 2023-07-14 09:14:02,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a8d06b27805b38e6244d8842031a7c9a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:02,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b1d375b87d8509ee5fcb2cb6b25d277d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:02,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326042416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326042416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326042416"}]},"ts":"1689326042416"} 2023-07-14 09:14:02,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326042416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326042416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326042416"}]},"ts":"1689326042416"} 2023-07-14 09:14:02,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure b1d375b87d8509ee5fcb2cb6b25d277d, server=jenkins-hbase9.apache.org,41907,1689325949930}] 2023-07-14 09:14:02,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure a8d06b27805b38e6244d8842031a7c9a, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:02,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:02,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:14:02,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:14:02,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a8d06b27805b38e6244d8842031a7c9a, disabling compactions & flushes 2023-07-14 09:14:02,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b1d375b87d8509ee5fcb2cb6b25d277d, disabling compactions & flushes 2023-07-14 09:14:02,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:14:02,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:14:02,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. after waiting 0 ms 2023-07-14 09:14:02,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:14:02,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:14:02,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:14:02,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. after waiting 0 ms 2023-07-14 09:14:02,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:14:02,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:02,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:02,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a. 2023-07-14 09:14:02,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a8d06b27805b38e6244d8842031a7c9a: 2023-07-14 09:14:02,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:02,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:14:02,683 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a8d06b27805b38e6244d8842031a7c9a, regionState=CLOSED 2023-07-14 09:14:02,683 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326042683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326042683"}]},"ts":"1689326042683"} 2023-07-14 09:14:02,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:02,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d. 2023-07-14 09:14:02,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b1d375b87d8509ee5fcb2cb6b25d277d: 2023-07-14 09:14:02,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:14:02,691 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b1d375b87d8509ee5fcb2cb6b25d277d, regionState=CLOSED 2023-07-14 09:14:02,691 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689326042691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326042691"}]},"ts":"1689326042691"} 2023-07-14 09:14:02,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-14 09:14:02,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure a8d06b27805b38e6244d8842031a7c9a, server=jenkins-hbase9.apache.org,38061,1689325950049 in 265 msec 2023-07-14 09:14:02,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a8d06b27805b38e6244d8842031a7c9a, UNASSIGN in 282 msec 2023-07-14 09:14:02,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-14 09:14:02,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure b1d375b87d8509ee5fcb2cb6b25d277d, server=jenkins-hbase9.apache.org,41907,1689325949930 in 271 msec 2023-07-14 09:14:02,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-14 09:14:02,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1d375b87d8509ee5fcb2cb6b25d277d, UNASSIGN in 285 msec 2023-07-14 09:14:02,704 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326042704"}]},"ts":"1689326042704"} 2023-07-14 09:14:02,706 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 09:14:02,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:02,710 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 09:14:02,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 318 msec 2023-07-14 09:14:03,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 09:14:03,009 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 09:14:03,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 09:14:03,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:03,015 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:03,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 09:14:03,017 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:03,020 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 09:14:03,023 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,023 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,023 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,023 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,024 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:03,024 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:03,024 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:03,025 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 09:14:03,027 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,027 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 09:14:03,030 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,030 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,031 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,031 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,033 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 09:14:03,033 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,039 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:14:03,042 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:14:03,042 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/recovered.edits] 2023-07-14 09:14:03,046 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/recovered.edits] 2023-07-14 09:14:03,050 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf/9a9c8186f8274a3c80506ef3ff4da009 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/cf/9a9c8186f8274a3c80506ef3ff4da009 2023-07-14 09:14:03,053 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf/1a88c04ef14c4758ab210e11d4aa703f to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/cf/1a88c04ef14c4758ab210e11d4aa703f 2023-07-14 09:14:03,057 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a/recovered.edits/9.seqid 2023-07-14 09:14:03,058 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/a8d06b27805b38e6244d8842031a7c9a 2023-07-14 09:14:03,060 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d/recovered.edits/9.seqid 2023-07-14 09:14:03,061 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testConsecutiveExports/b1d375b87d8509ee5fcb2cb6b25d277d 2023-07-14 09:14:03,061 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 09:14:03,064 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:03,067 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 09:14:03,072 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 09:14:03,073 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:03,073 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 09:14:03,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326043073"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:03,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326043073"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:03,085 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:14:03,085 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b1d375b87d8509ee5fcb2cb6b25d277d, NAME => 'testtb-testConsecutiveExports,,1689326003726.b1d375b87d8509ee5fcb2cb6b25d277d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a8d06b27805b38e6244d8842031a7c9a, NAME => 'testtb-testConsecutiveExports,1,1689326003726.a8d06b27805b38e6244d8842031a7c9a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:14:03,085 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 09:14:03,085 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326043085"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:03,088 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 09:14:03,091 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 09:14:03,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 80 msec 2023-07-14 09:14:03,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 09:14:03,131 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 09:14:03,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 09:14:03,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 09:14:03,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 09:14:03,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 09:14:03,257 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=750 (was 767), OpenFileDescriptor=897 (was 935), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=838 (was 691) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=1473 (was 1323) - AvailableMemoryMB LEAK? - 2023-07-14 09:14:03,257 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-14 09:14:03,291 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=838, ProcessCount=192, AvailableMemoryMB=1470 2023-07-14 09:14:03,291 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 09:14:03,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:14:03,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:03,301 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:03,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 09:14:03,302 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:03,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:03,314 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,315 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca empty. 2023-07-14 09:14:03,315 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,332 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,333 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 empty. 2023-07-14 09:14:03,334 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,334 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 09:14:03,389 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:03,390 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f05d7630be6b5b88269c8dffd3ee2aca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:03,391 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0066ff0baa85577373e9faf7a6ef85c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:03,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:03,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:03,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f05d7630be6b5b88269c8dffd3ee2aca, disabling compactions & flushes 2023-07-14 09:14:03,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. after waiting 0 ms 2023-07-14 09:14:03,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f05d7630be6b5b88269c8dffd3ee2aca: 2023-07-14 09:14:03,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:03,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0066ff0baa85577373e9faf7a6ef85c8, disabling compactions & flushes 2023-07-14 09:14:03,479 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. after waiting 0 ms 2023-07-14 09:14:03,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,479 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0066ff0baa85577373e9faf7a6ef85c8: 2023-07-14 09:14:03,483 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:03,484 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326043484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326043484"}]},"ts":"1689326043484"} 2023-07-14 09:14:03,485 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326043484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326043484"}]},"ts":"1689326043484"} 2023-07-14 09:14:03,491 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:03,493 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:03,493 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326043493"}]},"ts":"1689326043493"} 2023-07-14 09:14:03,494 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 09:14:03,497 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:03,499 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:03,499 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:03,499 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:03,499 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:03,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, ASSIGN}] 2023-07-14 09:14:03,502 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, ASSIGN 2023-07-14 09:14:03,502 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, ASSIGN 2023-07-14 09:14:03,507 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:14:03,508 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42505,1689325949776; forceNewPlan=false, retain=false 2023-07-14 09:14:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:03,658 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:03,662 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0066ff0baa85577373e9faf7a6ef85c8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:03,662 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f05d7630be6b5b88269c8dffd3ee2aca, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:03,662 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326043662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326043662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326043662"}]},"ts":"1689326043662"} 2023-07-14 09:14:03,662 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326043662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326043662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326043662"}]},"ts":"1689326043662"} 2023-07-14 09:14:03,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 0066ff0baa85577373e9faf7a6ef85c8, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:03,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure f05d7630be6b5b88269c8dffd3ee2aca, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:03,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0066ff0baa85577373e9faf7a6ef85c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:14:03,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. service=AccessControlService 2023-07-14 09:14:03,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:03,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:03,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,831 INFO [StoreOpener-0066ff0baa85577373e9faf7a6ef85c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f05d7630be6b5b88269c8dffd3ee2aca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:14:03,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. service=AccessControlService 2023-07-14 09:14:03,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:03,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:03,838 DEBUG [StoreOpener-0066ff0baa85577373e9faf7a6ef85c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf 2023-07-14 09:14:03,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,838 DEBUG [StoreOpener-0066ff0baa85577373e9faf7a6ef85c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf 2023-07-14 09:14:03,841 INFO [StoreOpener-0066ff0baa85577373e9faf7a6ef85c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0066ff0baa85577373e9faf7a6ef85c8 columnFamilyName cf 2023-07-14 09:14:03,842 INFO [StoreOpener-f05d7630be6b5b88269c8dffd3ee2aca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,844 DEBUG [StoreOpener-f05d7630be6b5b88269c8dffd3ee2aca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf 2023-07-14 09:14:03,844 DEBUG [StoreOpener-f05d7630be6b5b88269c8dffd3ee2aca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf 2023-07-14 09:14:03,845 INFO [StoreOpener-f05d7630be6b5b88269c8dffd3ee2aca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f05d7630be6b5b88269c8dffd3ee2aca columnFamilyName cf 2023-07-14 09:14:03,846 INFO [StoreOpener-f05d7630be6b5b88269c8dffd3ee2aca-1] regionserver.HStore(310): Store=f05d7630be6b5b88269c8dffd3ee2aca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:03,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,849 INFO [StoreOpener-0066ff0baa85577373e9faf7a6ef85c8-1] regionserver.HStore(310): Store=0066ff0baa85577373e9faf7a6ef85c8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:03,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:03,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:03,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f05d7630be6b5b88269c8dffd3ee2aca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75223996, jitterRate=0.12092489004135132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:03,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f05d7630be6b5b88269c8dffd3ee2aca: 2023-07-14 09:14:03,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca., pid=61, masterSystemTime=1689326043829 2023-07-14 09:14:03,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:03,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:03,859 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f05d7630be6b5b88269c8dffd3ee2aca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:03,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326043859"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326043859"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326043859"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326043859"}]},"ts":"1689326043859"} 2023-07-14 09:14:03,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:03,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0066ff0baa85577373e9faf7a6ef85c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61783123, jitterRate=-0.07935972511768341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:03,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0066ff0baa85577373e9faf7a6ef85c8: 2023-07-14 09:14:03,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-14 09:14:03,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure f05d7630be6b5b88269c8dffd3ee2aca, server=jenkins-hbase9.apache.org,42505,1689325949776 in 189 msec 2023-07-14 09:14:03,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8., pid=60, masterSystemTime=1689326043822 2023-07-14 09:14:03,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, ASSIGN in 365 msec 2023-07-14 09:14:03,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:03,881 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0066ff0baa85577373e9faf7a6ef85c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:03,881 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326043881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326043881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326043881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326043881"}]},"ts":"1689326043881"} 2023-07-14 09:14:03,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-14 09:14:03,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 0066ff0baa85577373e9faf7a6ef85c8, server=jenkins-hbase9.apache.org,38061,1689325950049 in 216 msec 2023-07-14 09:14:03,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-14 09:14:03,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, ASSIGN in 388 msec 2023-07-14 09:14:03,891 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:03,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326043891"}]},"ts":"1689326043891"} 2023-07-14 09:14:03,893 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 09:14:03,897 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:03,897 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 09:14:03,899 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 09:14:03,900 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,900 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,901 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,901 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:03,903 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:03,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:03,903 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:03,904 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:03,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:03,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:03,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 611 msec 2023-07-14 09:14:03,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 09:14:03,907 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 09:14:03,907 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-14 09:14:03,907 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:03,911 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-14 09:14:03,911 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:03,911 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-14 09:14:03,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:03,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326043914 (current time:1689326043914). 2023-07-14 09:14:03,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:03,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x41f21ce2 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:03,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3238d370, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:03,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:03,926 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:03,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41f21ce2 to 127.0.0.1:63612 2023-07-14 09:14:03,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:03,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x14d592f4 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:03,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45119980, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:03,941 DEBUG [hconnection-0x31466101-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:03,947 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:03,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:03,963 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:03,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14d592f4 to 127.0.0.1:63612 2023-07-14 09:14:03,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:03,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 09:14:03,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:03,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:03,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:03,978 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:03,986 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689326643986 2023-07-14 09:14:03,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:03,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:03,988 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:03,988 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:03,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:03,990 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:03,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 17 msec 2023-07-14 09:14:03,994 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:03,994 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689326643994 2023-07-14 09:14:04,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,029 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 09:14:04,029 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:04,031 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 09:14:04,031 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 09:14:04,032 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,032 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,035 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:04,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:04,035 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:04,035 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:04,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:04,035 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:04,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:04,035 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,036 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,036 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,036 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:04,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:04,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,042 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:04,042 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:04,047 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:04,047 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:04,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,047 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:04,047 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:04,047 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:04,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,049 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:04,049 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:04,049 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:04,049 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:04,049 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:04,050 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:04,050 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:04,050 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:04,052 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,052 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:04,054 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,054 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:04,055 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,055 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:04,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:04,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,057 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,058 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,058 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:04,058 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,058 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c0254e[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:04,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:04,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c0254e[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:04,063 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 09:14:04,063 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,065 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:04,065 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:04,065 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:04,065 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,065 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:04,066 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. started... 2023-07-14 09:14:04,077 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:04,077 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:04,077 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:04,082 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:04,084 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:04,084 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f05d7630be6b5b88269c8dffd3ee2aca: 2023-07-14 09:14:04,084 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,084 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:04,085 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:04,085 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. started... 2023-07-14 09:14:04,085 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:04,087 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0066ff0baa85577373e9faf7a6ef85c8: 2023-07-14 09:14:04,088 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:04,089 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:04,091 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:04,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:04,091 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:04,091 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:04,166 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. completed. 2023-07-14 09:14:04,166 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:04,166 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:04,166 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:04,166 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,166 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:04,166 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:04,168 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,168 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:04,168 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:04,169 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:04,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,178 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. completed. 2023-07-14 09:14:04,178 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:04,178 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:04,178 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:04,178 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,178 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:04,178 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,180 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:04,180 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,180 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:04,180 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:14:04,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 09:14:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:04,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:04,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 09:14:04,186 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 09:14:04,186 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:04,186 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:04,186 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,186 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:04,189 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:04,189 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:04,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,189 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:04,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:04,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,191 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,191 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,192 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,193 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,195 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:04,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:04,199 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:04,200 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:04,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:04,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:04,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:04,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:04,208 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,209 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:04,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:04,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:04,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:04,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:04,209 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,209 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:04,209 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:04,209 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,209 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,209 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:04,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:04,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:04,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:04,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-14 09:14:04,291 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:04,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:04,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:04,293 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:04,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 09:14:04,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,437 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689326043986Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326044210 (+224 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326044210Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326044236 (+26 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689326044302 (+66 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689326044436 (+134 ms) 2023-07-14 09:14:04,440 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:04,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 453 msec 2023-07-14 09:14:04,593 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:04,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:04,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42505] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:04,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:04,647 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,647 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:04,648 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:04,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:04,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326044690 (current time:1689326044690). 2023-07-14 09:14:04,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:04,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x2fa2bcf4 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:04,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76146344, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:04,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:04,726 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:04,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fa2bcf4 to 127.0.0.1:63612 2023-07-14 09:14:04,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:04,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x1daf5d75 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:04,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27500728, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:04,846 DEBUG [hconnection-0x728b5ec5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:04,850 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:04,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:04,857 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:04,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1daf5d75 to 127.0.0.1:63612 2023-07-14 09:14:04,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:04,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 09:14:04,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:04,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:04,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:04,863 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:04,864 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689326644864 2023-07-14 09:14:04,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 09:14:04,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:04,867 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:04,867 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:04,868 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 09:14:04,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:04,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-14 09:14:04,872 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:04,873 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689326644873 2023-07-14 09:14:04,967 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:04,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:04,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:04,969 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:05,169 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:05,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:05,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:05,171 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:05,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,304 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 09:14:05,305 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,305 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 09:14:05,305 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 09:14:05,305 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,305 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,308 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,308 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,308 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 09:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 09:14:05,311 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,311 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:05,311 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,311 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,311 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,311 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:05,312 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,312 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 09:14:05,313 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:05,314 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:05,314 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:05,313 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:05,313 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:05,316 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,316 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:05,315 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 09:14:05,316 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:05,316 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:05,316 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 09:14:05,316 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 09:14:05,318 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,318 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,320 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,320 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,320 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,320 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,321 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:05,321 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,321 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,321 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,321 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:05,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fb21fb4[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 09:14:05,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fb21fb4[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:05,343 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 09:14:05,343 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:05,345 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:05,345 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:05,345 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:05,345 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. started... 2023-07-14 09:14:05,346 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0066ff0baa85577373e9faf7a6ef85c8 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-14 09:14:05,346 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:05,346 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:05,346 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:05,346 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. started... 2023-07-14 09:14:05,346 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f05d7630be6b5b88269c8dffd3ee2aca 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-14 09:14:05,347 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,347 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,347 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:05,443 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/.tmp/cf/5a04b21902674706ab899894b66325c9 2023-07-14 09:14:05,446 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/.tmp/cf/f054f21797304d13ab5e6acb5797b477 2023-07-14 09:14:05,453 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/.tmp/cf/5a04b21902674706ab899894b66325c9 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf/5a04b21902674706ab899894b66325c9 2023-07-14 09:14:05,458 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf/5a04b21902674706ab899894b66325c9, entries=49, sequenceid=6, filesize=8.1 K 2023-07-14 09:14:05,460 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 0066ff0baa85577373e9faf7a6ef85c8 in 115ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:05,460 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 09:14:05,461 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0066ff0baa85577373e9faf7a6ef85c8: 2023-07-14 09:14:05,461 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,461 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:05,461 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf/5a04b21902674706ab899894b66325c9] hfiles 2023-07-14 09:14:05,461 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf/5a04b21902674706ab899894b66325c9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,467 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/.tmp/cf/f054f21797304d13ab5e6acb5797b477 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf/f054f21797304d13ab5e6acb5797b477 2023-07-14 09:14:05,471 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:05,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:05,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:05,474 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 09:14:05,481 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. completed. 2023-07-14 09:14:05,481 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:05,481 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:05,481 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:05,481 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,481 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:05,481 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf/f054f21797304d13ab5e6acb5797b477, entries=1, sequenceid=6, filesize=4.9 K 2023-07-14 09:14:05,481 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:05,483 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for f05d7630be6b5b88269c8dffd3ee2aca in 137ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:05,484 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f05d7630be6b5b88269c8dffd3ee2aca: 2023-07-14 09:14:05,485 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,485 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:05,485 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:05,485 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf/f054f21797304d13ab5e6acb5797b477] hfiles 2023-07-14 09:14:05,485 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf/f054f21797304d13ab5e6acb5797b477 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,485 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,485 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,486 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:05,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 09:14:05,522 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. completed. 2023-07-14 09:14:05,522 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:05,522 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:05,522 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:05,522 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,522 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 09:14:05,522 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:05,524 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,524 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 09:14:05,525 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,525 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 09:14:05,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:14:05,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 09:14:05,532 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 09:14:05,532 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:05,532 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:05,532 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,532 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:05,537 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,538 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:05,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,537 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:05,538 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,539 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,540 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,542 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:05,543 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,543 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,547 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,547 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,547 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,547 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,550 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,550 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,550 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,550 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,550 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,550 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:05,550 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:05,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,552 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,552 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:05,552 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:05,552 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,552 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,557 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:05,558 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:05,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 09:14:05,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:05,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689326044864Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689326045552 (+688 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689326045552Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689326045561 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689326045625 (+64 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689326045713 (+88 ms) 2023-07-14 09:14:05,718 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 09:14:05,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 853 msec 2023-07-14 09:14:05,974 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:05,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 09:14:05,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:06,018 DEBUG [Listener at jenkins-hbase9.apache.org/45963] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:14:06,026 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:14:06,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 09:14:06,029 DEBUG [Listener at jenkins-hbase9.apache.org/45963] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:14:06,038 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:14:06,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41907] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 09:14:06,040 DEBUG [Listener at jenkins-hbase9.apache.org/45963] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 09:14:06,043 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 09:14:06,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42505] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 09:14:06,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:14:06,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:06,054 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:06,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 09:14:06,056 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:06,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:06,063 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,063 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,063 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 empty. 2023-07-14 09:14:06,063 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 empty. 2023-07-14 09:14:06,064 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,064 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 09:14:06,084 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:06,086 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9cef020f8eba41779f2ba01d15ae22b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:06,086 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d07dc6cb8b11df86596a0d4c7d806e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:06,114 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:06,114 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9cef020f8eba41779f2ba01d15ae22b4, disabling compactions & flushes 2023-07-14 09:14:06,114 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,114 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,114 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. after waiting 0 ms 2023-07-14 09:14:06,114 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,114 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,114 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9cef020f8eba41779f2ba01d15ae22b4: 2023-07-14 09:14:06,127 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:06,127 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 0d07dc6cb8b11df86596a0d4c7d806e8, disabling compactions & flushes 2023-07-14 09:14:06,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,127 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,127 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. after waiting 0 ms 2023-07-14 09:14:06,127 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,127 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 0d07dc6cb8b11df86596a0d4c7d806e8: 2023-07-14 09:14:06,131 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:06,133 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326046132"}]},"ts":"1689326046132"} 2023-07-14 09:14:06,133 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326046132"}]},"ts":"1689326046132"} 2023-07-14 09:14:06,136 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:06,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:06,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326046137"}]},"ts":"1689326046137"} 2023-07-14 09:14:06,140 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 09:14:06,144 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:06,145 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:06,146 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:06,146 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:06,146 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:06,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, ASSIGN}] 2023-07-14 09:14:06,149 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, ASSIGN 2023-07-14 09:14:06,149 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, ASSIGN 2023-07-14 09:14:06,151 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42505,1689325949776; forceNewPlan=false, retain=false 2023-07-14 09:14:06,152 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:14:06,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:06,302 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:06,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9cef020f8eba41779f2ba01d15ae22b4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:06,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0d07dc6cb8b11df86596a0d4c7d806e8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:06,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326046305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326046305"}]},"ts":"1689326046305"} 2023-07-14 09:14:06,305 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326046305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326046305"}]},"ts":"1689326046305"} 2023-07-14 09:14:06,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 9cef020f8eba41779f2ba01d15ae22b4, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:06,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 0d07dc6cb8b11df86596a0d4c7d806e8, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:06,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:06,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9cef020f8eba41779f2ba01d15ae22b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 09:14:06,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. service=AccessControlService 2023-07-14 09:14:06,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d07dc6cb8b11df86596a0d4c7d806e8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 09:14:06,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. service=AccessControlService 2023-07-14 09:14:06,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:06,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:06,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,469 INFO [StoreOpener-9cef020f8eba41779f2ba01d15ae22b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,486 INFO [StoreOpener-0d07dc6cb8b11df86596a0d4c7d806e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,486 DEBUG [StoreOpener-9cef020f8eba41779f2ba01d15ae22b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf 2023-07-14 09:14:06,486 DEBUG [StoreOpener-9cef020f8eba41779f2ba01d15ae22b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf 2023-07-14 09:14:06,487 INFO [StoreOpener-9cef020f8eba41779f2ba01d15ae22b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cef020f8eba41779f2ba01d15ae22b4 columnFamilyName cf 2023-07-14 09:14:06,487 DEBUG [StoreOpener-0d07dc6cb8b11df86596a0d4c7d806e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf 2023-07-14 09:14:06,487 DEBUG [StoreOpener-0d07dc6cb8b11df86596a0d4c7d806e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf 2023-07-14 09:14:06,487 INFO [StoreOpener-9cef020f8eba41779f2ba01d15ae22b4-1] regionserver.HStore(310): Store=9cef020f8eba41779f2ba01d15ae22b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:06,488 INFO [StoreOpener-0d07dc6cb8b11df86596a0d4c7d806e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d07dc6cb8b11df86596a0d4c7d806e8 columnFamilyName cf 2023-07-14 09:14:06,488 INFO [StoreOpener-0d07dc6cb8b11df86596a0d4c7d806e8-1] regionserver.HStore(310): Store=0d07dc6cb8b11df86596a0d4c7d806e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:06,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:06,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:06,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0d07dc6cb8b11df86596a0d4c7d806e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73003159, jitterRate=0.08783183991909027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:06,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0d07dc6cb8b11df86596a0d4c7d806e8: 2023-07-14 09:14:06,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9cef020f8eba41779f2ba01d15ae22b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62970324, jitterRate=-0.06166905164718628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:06,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9cef020f8eba41779f2ba01d15ae22b4: 2023-07-14 09:14:06,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8., pid=70, masterSystemTime=1689326046463 2023-07-14 09:14:06,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4., pid=69, masterSystemTime=1689326046461 2023-07-14 09:14:06,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,509 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0d07dc6cb8b11df86596a0d4c7d806e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:06,510 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046509"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326046509"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326046509"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326046509"}]},"ts":"1689326046509"} 2023-07-14 09:14:06,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9cef020f8eba41779f2ba01d15ae22b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:06,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046510"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326046510"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326046510"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326046510"}]},"ts":"1689326046510"} 2023-07-14 09:14:06,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-14 09:14:06,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 0d07dc6cb8b11df86596a0d4c7d806e8, server=jenkins-hbase9.apache.org,38061,1689325950049 in 202 msec 2023-07-14 09:14:06,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-14 09:14:06,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 9cef020f8eba41779f2ba01d15ae22b4, server=jenkins-hbase9.apache.org,42505,1689325949776 in 221 msec 2023-07-14 09:14:06,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, ASSIGN in 392 msec 2023-07-14 09:14:06,542 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-14 09:14:06,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, ASSIGN in 392 msec 2023-07-14 09:14:06,544 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:06,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326046544"}]},"ts":"1689326046544"} 2023-07-14 09:14:06,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 09:14:06,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:06,550 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 09:14:06,555 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 09:14:06,556 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:06,556 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:06,556 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:06,556 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:06,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 511 msec 2023-07-14 09:14:06,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 09:14:06,662 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 09:14:06,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions 0d07dc6cb8b11df86596a0d4c7d806e8, 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0d07dc6cb8b11df86596a0d4c7d806e8, 9cef020f8eba41779f2ba01d15ae22b4], force=true 2023-07-14 09:14:06,716 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0d07dc6cb8b11df86596a0d4c7d806e8, 9cef020f8eba41779f2ba01d15ae22b4], force=true 2023-07-14 09:14:06,716 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0d07dc6cb8b11df86596a0d4c7d806e8, 9cef020f8eba41779f2ba01d15ae22b4], force=true 2023-07-14 09:14:06,716 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0d07dc6cb8b11df86596a0d4c7d806e8, 9cef020f8eba41779f2ba01d15ae22b4], force=true 2023-07-14 09:14:06,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:06,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, UNASSIGN}] 2023-07-14 09:14:06,761 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, UNASSIGN 2023-07-14 09:14:06,761 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, UNASSIGN 2023-07-14 09:14:06,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0d07dc6cb8b11df86596a0d4c7d806e8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:06,769 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326046768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326046768"}]},"ts":"1689326046768"} 2023-07-14 09:14:06,769 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9cef020f8eba41779f2ba01d15ae22b4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:06,769 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326046769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326046769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326046769"}]},"ts":"1689326046769"} 2023-07-14 09:14:06,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 0d07dc6cb8b11df86596a0d4c7d806e8, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:06,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 9cef020f8eba41779f2ba01d15ae22b4, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:06,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:06,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:06,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0d07dc6cb8b11df86596a0d4c7d806e8, disabling compactions & flushes 2023-07-14 09:14:06,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. after waiting 0 ms 2023-07-14 09:14:06,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:06,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 0d07dc6cb8b11df86596a0d4c7d806e8 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 09:14:06,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:06,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9cef020f8eba41779f2ba01d15ae22b4, disabling compactions & flushes 2023-07-14 09:14:06,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. after waiting 0 ms 2023-07-14 09:14:06,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:06,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 9cef020f8eba41779f2ba01d15ae22b4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 09:14:07,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/.tmp/cf/245414e8caf94f76a5b247fd58a6f0ce 2023-07-14 09:14:07,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:07,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/.tmp/cf/245414e8caf94f76a5b247fd58a6f0ce as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf/245414e8caf94f76a5b247fd58a6f0ce 2023-07-14 09:14:07,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf/245414e8caf94f76a5b247fd58a6f0ce, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 09:14:07,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9cef020f8eba41779f2ba01d15ae22b4 in 122ms, sequenceid=5, compaction requested=false 2023-07-14 09:14:07,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 09:14:07,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/.tmp/cf/8248372a42cb4d4daebdf2acd9768aba 2023-07-14 09:14:07,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 09:14:07,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:07,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4. 2023-07-14 09:14:07,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9cef020f8eba41779f2ba01d15ae22b4: 2023-07-14 09:14:07,099 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9cef020f8eba41779f2ba01d15ae22b4, regionState=CLOSED 2023-07-14 09:14:07,099 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326047099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326047099"}]},"ts":"1689326047099"} 2023-07-14 09:14:07,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:07,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/.tmp/cf/8248372a42cb4d4daebdf2acd9768aba as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf/8248372a42cb4d4daebdf2acd9768aba 2023-07-14 09:14:07,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-14 09:14:07,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 9cef020f8eba41779f2ba01d15ae22b4, server=jenkins-hbase9.apache.org,42505,1689325949776 in 329 msec 2023-07-14 09:14:07,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf/8248372a42cb4d4daebdf2acd9768aba, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 09:14:07,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cef020f8eba41779f2ba01d15ae22b4, UNASSIGN in 351 msec 2023-07-14 09:14:07,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0d07dc6cb8b11df86596a0d4c7d806e8 in 181ms, sequenceid=5, compaction requested=false 2023-07-14 09:14:07,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 09:14:07,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:07,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8. 2023-07-14 09:14:07,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0d07dc6cb8b11df86596a0d4c7d806e8: 2023-07-14 09:14:07,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:07,171 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0d07dc6cb8b11df86596a0d4c7d806e8, regionState=CLOSED 2023-07-14 09:14:07,171 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689326047171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326047171"}]},"ts":"1689326047171"} 2023-07-14 09:14:07,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-14 09:14:07,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 0d07dc6cb8b11df86596a0d4c7d806e8, server=jenkins-hbase9.apache.org,38061,1689325950049 in 402 msec 2023-07-14 09:14:07,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-14 09:14:07,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d07dc6cb8b11df86596a0d4c7d806e8, UNASSIGN in 427 msec 2023-07-14 09:14:07,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:07,362 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0004_000001 (auth:SIMPLE) 2023-07-14 09:14:07,782 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 09:14:07,791 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046046.0d07dc6cb8b11df86596a0d4c7d806e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:07,791 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689326046046.9cef020f8eba41779f2ba01d15ae22b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:07,791 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:07,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:07,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, ASSIGN}] 2023-07-14 09:14:07,867 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, ASSIGN 2023-07-14 09:14:07,871 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:14:08,021 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 09:14:08,024 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f880bae3c635712ca8f8f9b80c085e62, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:08,024 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326048024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326048024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326048024"}]},"ts":"1689326048024"} 2023-07-14 09:14:08,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f880bae3c635712ca8f8f9b80c085e62, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:08,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f880bae3c635712ca8f8f9b80c085e62, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.', STARTKEY => '', ENDKEY => ''} 2023-07-14 09:14:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. service=AccessControlService 2023-07-14 09:14:08,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/.regioninfo 2023-07-14 09:14:08,252 INFO [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,253 DEBUG [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf 2023-07-14 09:14:08,255 DEBUG [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf 2023-07-14 09:14:08,255 INFO [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f880bae3c635712ca8f8f9b80c085e62 columnFamilyName cf 2023-07-14 09:14:08,291 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:08,321 DEBUG [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] regionserver.HStore(539): loaded hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/245414e8caf94f76a5b247fd58a6f0ce.9cef020f8eba41779f2ba01d15ae22b4->hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf/245414e8caf94f76a5b247fd58a6f0ce-top 2023-07-14 09:14:08,331 DEBUG [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] regionserver.HStore(539): loaded hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/8248372a42cb4d4daebdf2acd9768aba.0d07dc6cb8b11df86596a0d4c7d806e8->hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf/8248372a42cb4d4daebdf2acd9768aba-top 2023-07-14 09:14:08,332 INFO [StoreOpener-f880bae3c635712ca8f8f9b80c085e62-1] regionserver.HStore(310): Store=f880bae3c635712ca8f8f9b80c085e62/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:08,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:08,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f880bae3c635712ca8f8f9b80c085e62; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71444597, jitterRate=0.06460745632648468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:08,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f880bae3c635712ca8f8f9b80c085e62: 2023-07-14 09:14:08,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62., pid=77, masterSystemTime=1689326048178 2023-07-14 09:14:08,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.,because compaction is disabled. 2023-07-14 09:14:08,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:08,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:08,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f880bae3c635712ca8f8f9b80c085e62, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:08,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326048361"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326048361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326048361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326048361"}]},"ts":"1689326048361"} 2023-07-14 09:14:08,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 09:14:08,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f880bae3c635712ca8f8f9b80c085e62, server=jenkins-hbase9.apache.org,38061,1689325950049 in 344 msec 2023-07-14 09:14:08,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 09:14:08,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, ASSIGN in 510 msec 2023-07-14 09:14:08,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0d07dc6cb8b11df86596a0d4c7d806e8, 9cef020f8eba41779f2ba01d15ae22b4], force=true in 1.6750 sec 2023-07-14 09:14:08,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 09:14:08,850 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 09:14:08,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 09:14:08,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326048851 (current time:1689326048851). 2023-07-14 09:14:08,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:08,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x5e02ea6c to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:08,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1689deb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:08,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:08,875 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:08,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e02ea6c to 127.0.0.1:63612 2023-07-14 09:14:08,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:08,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x03906a81 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:08,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a08b115, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:08,997 DEBUG [hconnection-0x122cba8c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:09,004 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:09,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:09,014 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:09,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03906a81 to 127.0.0.1:63612 2023-07-14 09:14:09,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:09,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 09:14:09,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:09,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 09:14:09,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 09:14:09,029 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 09:14:09,034 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689326649034 2023-07-14 09:14:09,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 09:14:09,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,042 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:09,043 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 09:14:09,043 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:09,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 09:14:09,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 24 msec 2023-07-14 09:14:09,054 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 09:14:09,055 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689326649055 2023-07-14 09:14:09,144 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:09,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:09,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:09,146 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:09,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,169 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 09:14:09,169 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:09,169 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 09:14:09,169 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 09:14:09,170 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,170 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,171 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:09,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:09,171 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:09,171 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:09,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:09,172 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:09,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,172 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,172 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 09:14:09,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,173 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 09:14:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 09:14:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 09:14:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 09:14:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 09:14:09,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,183 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 09:14:09,183 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:09,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,192 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 09:14:09,192 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:09,211 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 09:14:09,211 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 09:14:09,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,211 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 09:14:09,212 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 09:14:09,212 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 09:14:09,211 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 09:14:09,212 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 09:14:09,212 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:09,214 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 09:14:09,214 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 09:14:09,214 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 09:14:09,215 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,215 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:09,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:09,216 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,218 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:09,218 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,218 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:09,218 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,218 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:09,219 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,219 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:09,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:09,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 09:14:09,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@338ef6df[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:09,220 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 09:14:09,220 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 09:14:09,226 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 09:14:09,226 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 09:14:09,226 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,226 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,227 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:09,227 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 09:14:09,227 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 09:14:09,227 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:09,229 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 09:14:09,229 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:09,229 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 09:14:09,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 09:14:09,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:09,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 09:14:09,235 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:09,243 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:09,244 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:09,244 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. started... 2023-07-14 09:14:09,246 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f880bae3c635712ca8f8f9b80c085e62: 2023-07-14 09:14:09,249 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,249 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:09,249 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/245414e8caf94f76a5b247fd58a6f0ce.9cef020f8eba41779f2ba01d15ae22b4->hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf/245414e8caf94f76a5b247fd58a6f0ce-top, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/8248372a42cb4d4daebdf2acd9768aba.0d07dc6cb8b11df86596a0d4c7d806e8->hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf/8248372a42cb4d4daebdf2acd9768aba-top] hfiles 2023-07-14 09:14:09,249 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/245414e8caf94f76a5b247fd58a6f0ce.9cef020f8eba41779f2ba01d15ae22b4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,253 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/8248372a42cb4d4daebdf2acd9768aba.0d07dc6cb8b11df86596a0d4c7d806e8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,305 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. completed. 2023-07-14 09:14:09,305 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:09,305 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:09,305 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:09,305 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,305 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 09:14:09,305 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:09,311 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:09,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:09,313 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 09:14:09,313 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:09,313 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 09:14:09,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:09,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:09,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:09,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:09,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 09:14:09,327 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 09:14:09,327 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:09,327 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:09,327 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,327 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:09,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:09,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:09,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:09,329 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:09,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:09,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:09,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:09,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:09,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:09,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:09,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:09,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,331 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,332 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:09,333 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:09,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,335 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,335 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,336 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:09,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:09,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,340 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:09,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:09,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:09,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:09,339 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,340 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:09,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:09,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:09,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:09,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:09,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:09,346 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:09,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:09,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:09,348 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:09,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 09:14:09,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,600 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689326049037Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326049340 (+303 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326049340Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326049358 (+18 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689326049438 (+80 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689326049599 (+161 ms) 2023-07-14 09:14:09,604 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 09:14:09,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 562 msec 2023-07-14 09:14:09,648 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:09,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 09:14:09,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:09,650 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650 2023-07-14 09:14:09,650 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43917, tgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650, rawTgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:14:09,688 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:14:09,688 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_520007866_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,688 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 09:14:09,708 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:09,812 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,813 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,813 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,814 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,815 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,815 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,815 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,915 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-2811108195123229928.jar 2023-07-14 09:14:09,916 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,916 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,917 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,917 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,918 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,918 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:09,919 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:14:09,920 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:14:09,920 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:14:09,921 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:14:09,922 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:14:09,922 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:14:09,923 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:14:09,923 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:14:09,924 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:14:09,924 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:14:09,925 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:09,926 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:09,926 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:09,930 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:09,931 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:09,931 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:09,932 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:11,619 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:14:11,624 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 09:14:11,627 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 09:14:11,846 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:11,846 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:12,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:13,688 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:20,574 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:23,026 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:30,234 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:32,110 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:14:32,111 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:14:32,132 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,133 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:14:32,134 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:14:32,134 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,135 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 09:14:32,135 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 09:14:32,135 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,136 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 09:14:32,136 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326049650/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 09:14:32,175 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326072183"}]},"ts":"1689326072183"} 2023-07-14 09:14:32,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 09:14:32,186 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 09:14:32,188 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 09:14:32,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, UNASSIGN}] 2023-07-14 09:14:32,195 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, UNASSIGN 2023-07-14 09:14:32,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f880bae3c635712ca8f8f9b80c085e62, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:32,198 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326072197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326072197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326072197"}]},"ts":"1689326072197"} 2023-07-14 09:14:32,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f880bae3c635712ca8f8f9b80c085e62, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:32,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 09:14:32,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f880bae3c635712ca8f8f9b80c085e62, disabling compactions & flushes 2023-07-14 09:14:32,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. after waiting 0 ms 2023-07-14 09:14:32,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:32,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 09:14:32,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:32,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62. 2023-07-14 09:14:32,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f880bae3c635712ca8f8f9b80c085e62: 2023-07-14 09:14:32,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:32,418 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f880bae3c635712ca8f8f9b80c085e62, regionState=CLOSED 2023-07-14 09:14:32,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689326072418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326072418"}]},"ts":"1689326072418"} 2023-07-14 09:14:32,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 09:14:32,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f880bae3c635712ca8f8f9b80c085e62, server=jenkins-hbase9.apache.org,38061,1689325950049 in 221 msec 2023-07-14 09:14:32,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 09:14:32,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f880bae3c635712ca8f8f9b80c085e62, UNASSIGN in 236 msec 2023-07-14 09:14:32,431 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326072431"}]},"ts":"1689326072431"} 2023-07-14 09:14:32,433 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 09:14:32,434 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 09:14:32,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 259 msec 2023-07-14 09:14:32,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 09:14:32,488 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 09:14:32,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,495 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,497 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,497 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,503 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 09:14:32,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 09:14:32,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 09:14:32,504 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 09:14:32,505 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,505 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,505 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:32,506 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,505 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:32,506 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:32,506 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,506 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:32,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:32,512 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:32,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:32,513 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:32,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:32,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 09:14:32,516 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/recovered.edits] 2023-07-14 09:14:32,519 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:32,522 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/recovered.edits] 2023-07-14 09:14:32,527 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf/245414e8caf94f76a5b247fd58a6f0ce to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/cf/245414e8caf94f76a5b247fd58a6f0ce 2023-07-14 09:14:32,533 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:32,534 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/recovered.edits/8.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4/recovered.edits/8.seqid 2023-07-14 09:14:32,534 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/245414e8caf94f76a5b247fd58a6f0ce.9cef020f8eba41779f2ba01d15ae22b4 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/245414e8caf94f76a5b247fd58a6f0ce.9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:32,535 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cef020f8eba41779f2ba01d15ae22b4 2023-07-14 09:14:32,540 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/recovered.edits] 2023-07-14 09:14:32,540 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/8248372a42cb4d4daebdf2acd9768aba.0d07dc6cb8b11df86596a0d4c7d806e8 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/cf/8248372a42cb4d4daebdf2acd9768aba.0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:32,548 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf/8248372a42cb4d4daebdf2acd9768aba to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/cf/8248372a42cb4d4daebdf2acd9768aba 2023-07-14 09:14:32,552 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/recovered.edits/12.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62/recovered.edits/12.seqid 2023-07-14 09:14:32,553 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f880bae3c635712ca8f8f9b80c085e62 2023-07-14 09:14:32,564 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/recovered.edits/8.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8/recovered.edits/8.seqid 2023-07-14 09:14:32,564 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d07dc6cb8b11df86596a0d4c7d806e8 2023-07-14 09:14:32,564 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 09:14:32,567 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,582 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 09:14:32,595 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 09:14:32,597 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,597 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 09:14:32,598 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326072597"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:32,602 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 09:14:32,602 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f880bae3c635712ca8f8f9b80c085e62, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689326046047.f880bae3c635712ca8f8f9b80c085e62.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 09:14:32,602 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 09:14:32,602 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326072602"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:32,607 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 09:14:32,610 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:32,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 121 msec 2023-07-14 09:14:32,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 09:14:32,618 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 09:14:32,619 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:32,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:32,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:32,628 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326072628"}]},"ts":"1689326072628"} 2023-07-14 09:14:32,630 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 09:14:32,631 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 09:14:32,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, UNASSIGN}] 2023-07-14 09:14:32,634 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, UNASSIGN 2023-07-14 09:14:32,636 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, UNASSIGN 2023-07-14 09:14:32,638 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0066ff0baa85577373e9faf7a6ef85c8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:32,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f05d7630be6b5b88269c8dffd3ee2aca, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:32,638 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326072638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326072638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326072638"}]},"ts":"1689326072638"} 2023-07-14 09:14:32,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326072637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326072637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326072637"}]},"ts":"1689326072637"} 2023-07-14 09:14:32,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 0066ff0baa85577373e9faf7a6ef85c8, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:32,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure f05d7630be6b5b88269c8dffd3ee2aca, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:32,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:32,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:32,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0066ff0baa85577373e9faf7a6ef85c8, disabling compactions & flushes 2023-07-14 09:14:32,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:32,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:32,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. after waiting 0 ms 2023-07-14 09:14:32,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:32,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:32,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f05d7630be6b5b88269c8dffd3ee2aca, disabling compactions & flushes 2023-07-14 09:14:32,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:32,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:32,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. after waiting 0 ms 2023-07-14 09:14:32,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:32,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:32,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:32,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:32,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8. 2023-07-14 09:14:32,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0066ff0baa85577373e9faf7a6ef85c8: 2023-07-14 09:14:32,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:32,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca. 2023-07-14 09:14:32,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f05d7630be6b5b88269c8dffd3ee2aca: 2023-07-14 09:14:32,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:32,910 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0066ff0baa85577373e9faf7a6ef85c8, regionState=CLOSED 2023-07-14 09:14:32,910 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326072910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326072910"}]},"ts":"1689326072910"} 2023-07-14 09:14:32,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:32,913 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f05d7630be6b5b88269c8dffd3ee2aca, regionState=CLOSED 2023-07-14 09:14:32,913 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689326072913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326072913"}]},"ts":"1689326072913"} 2023-07-14 09:14:32,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-14 09:14:32,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 0066ff0baa85577373e9faf7a6ef85c8, server=jenkins-hbase9.apache.org,38061,1689325950049 in 271 msec 2023-07-14 09:14:32,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0066ff0baa85577373e9faf7a6ef85c8, UNASSIGN in 285 msec 2023-07-14 09:14:32,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-14 09:14:32,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure f05d7630be6b5b88269c8dffd3ee2aca, server=jenkins-hbase9.apache.org,42505,1689325949776 in 267 msec 2023-07-14 09:14:32,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-14 09:14:32,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f05d7630be6b5b88269c8dffd3ee2aca, UNASSIGN in 289 msec 2023-07-14 09:14:32,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:32,930 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326072929"}]},"ts":"1689326072929"} 2023-07-14 09:14:32,931 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 09:14:32,934 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 09:14:32,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 316 msec 2023-07-14 09:14:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 09:14:33,234 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 09:14:33,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,240 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,242 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,243 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,248 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:33,248 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:33,250 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,250 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,250 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,250 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,251 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 09:14:33,252 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,252 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,252 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,252 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,252 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,253 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,253 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,253 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,253 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/recovered.edits] 2023-07-14 09:14:33,253 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/recovered.edits] 2023-07-14 09:14:33,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 09:14:33,262 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf/5a04b21902674706ab899894b66325c9 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/cf/5a04b21902674706ab899894b66325c9 2023-07-14 09:14:33,263 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf/f054f21797304d13ab5e6acb5797b477 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/cf/f054f21797304d13ab5e6acb5797b477 2023-07-14 09:14:33,266 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8/recovered.edits/9.seqid 2023-07-14 09:14:33,266 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca/recovered.edits/9.seqid 2023-07-14 09:14:33,267 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0066ff0baa85577373e9faf7a6ef85c8 2023-07-14 09:14:33,267 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f05d7630be6b5b88269c8dffd3ee2aca 2023-07-14 09:14:33,267 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 09:14:33,269 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,272 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 09:14:33,273 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 09:14:33,275 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,275 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 09:14:33,275 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326073275"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:33,275 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326073275"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:33,277 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:14:33,277 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f05d7630be6b5b88269c8dffd3ee2aca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689326043293.f05d7630be6b5b88269c8dffd3ee2aca.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0066ff0baa85577373e9faf7a6ef85c8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689326043293.0066ff0baa85577373e9faf7a6ef85c8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:14:33,277 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 09:14:33,277 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326073277"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:33,278 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 09:14:33,280 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 45 msec 2023-07-14 09:14:33,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 09:14:33,355 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 09:14:33,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 09:14:33,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 09:14:33,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 09:14:33,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 09:14:33,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 09:14:33,413 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:52348 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:37600 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:33855 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:58848 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1599381392_1 at /127.0.0.1:47360 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:52332 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=986 (was 838) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 192), AvailableMemoryMB=2446 (was 1470) - AvailableMemoryMB LEAK? - 2023-07-14 09:14:33,413 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-14 09:14:33,449 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=986, ProcessCount=190, AvailableMemoryMB=2444 2023-07-14 09:14:33,449 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-14 09:14:33,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:14:33,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:33,457 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:33,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 09:14:33,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:33,460 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,461 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,461 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 empty. 2023-07-14 09:14:33,461 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e empty. 2023-07-14 09:14:33,461 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,462 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,462 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 09:14:33,498 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:33,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8ce8fbc966881de1e2a3cba42aea1157, NAME => 'testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:33,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0eb83371ca7f933a443084a2f1693f8e, NAME => 'testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:33,532 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:33,533 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8ce8fbc966881de1e2a3cba42aea1157, disabling compactions & flushes 2023-07-14 09:14:33,533 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,533 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,533 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. after waiting 0 ms 2023-07-14 09:14:33,533 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,533 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,533 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8ce8fbc966881de1e2a3cba42aea1157: 2023-07-14 09:14:33,535 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:33,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0eb83371ca7f933a443084a2f1693f8e, disabling compactions & flushes 2023-07-14 09:14:33,536 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. after waiting 0 ms 2023-07-14 09:14:33,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,536 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,536 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0eb83371ca7f933a443084a2f1693f8e: 2023-07-14 09:14:33,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:33,539 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326073539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326073539"}]},"ts":"1689326073539"} 2023-07-14 09:14:33,539 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326073539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326073539"}]},"ts":"1689326073539"} 2023-07-14 09:14:33,541 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:33,542 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:33,542 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326073542"}]},"ts":"1689326073542"} 2023-07-14 09:14:33,545 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 09:14:33,549 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:33,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:33,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:33,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:33,551 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:33,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, ASSIGN}] 2023-07-14 09:14:33,555 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, ASSIGN 2023-07-14 09:14:33,555 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, ASSIGN 2023-07-14 09:14:33,557 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42505,1689325949776; forceNewPlan=false, retain=false 2023-07-14 09:14:33,558 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:14:33,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:33,707 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:33,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8ce8fbc966881de1e2a3cba42aea1157, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:33,711 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0eb83371ca7f933a443084a2f1693f8e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:33,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326073711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326073711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326073711"}]},"ts":"1689326073711"} 2023-07-14 09:14:33,711 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326073711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326073711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326073711"}]},"ts":"1689326073711"} 2023-07-14 09:14:33,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 8ce8fbc966881de1e2a3cba42aea1157, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:33,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0eb83371ca7f933a443084a2f1693f8e, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:33,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:33,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8ce8fbc966881de1e2a3cba42aea1157, NAME => 'testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:14:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. service=AccessControlService 2023-07-14 09:14:33,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:33,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0eb83371ca7f933a443084a2f1693f8e, NAME => 'testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:14:33,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. service=AccessControlService 2023-07-14 09:14:33,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:33,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:33,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,872 INFO [StoreOpener-8ce8fbc966881de1e2a3cba42aea1157-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,873 INFO [StoreOpener-0eb83371ca7f933a443084a2f1693f8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,874 DEBUG [StoreOpener-8ce8fbc966881de1e2a3cba42aea1157-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf 2023-07-14 09:14:33,874 DEBUG [StoreOpener-8ce8fbc966881de1e2a3cba42aea1157-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf 2023-07-14 09:14:33,874 INFO [StoreOpener-8ce8fbc966881de1e2a3cba42aea1157-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ce8fbc966881de1e2a3cba42aea1157 columnFamilyName cf 2023-07-14 09:14:33,874 DEBUG [StoreOpener-0eb83371ca7f933a443084a2f1693f8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf 2023-07-14 09:14:33,875 DEBUG [StoreOpener-0eb83371ca7f933a443084a2f1693f8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf 2023-07-14 09:14:33,875 INFO [StoreOpener-0eb83371ca7f933a443084a2f1693f8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eb83371ca7f933a443084a2f1693f8e columnFamilyName cf 2023-07-14 09:14:33,875 INFO [StoreOpener-8ce8fbc966881de1e2a3cba42aea1157-1] regionserver.HStore(310): Store=8ce8fbc966881de1e2a3cba42aea1157/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:33,875 INFO [StoreOpener-0eb83371ca7f933a443084a2f1693f8e-1] regionserver.HStore(310): Store=0eb83371ca7f933a443084a2f1693f8e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:33,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:33,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:33,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8ce8fbc966881de1e2a3cba42aea1157; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68027012, jitterRate=0.013681471347808838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8ce8fbc966881de1e2a3cba42aea1157: 2023-07-14 09:14:33,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0eb83371ca7f933a443084a2f1693f8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66490743, jitterRate=-0.009210720658302307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0eb83371ca7f933a443084a2f1693f8e: 2023-07-14 09:14:33,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e., pid=94, masterSystemTime=1689326073866 2023-07-14 09:14:33,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157., pid=93, masterSystemTime=1689326073865 2023-07-14 09:14:33,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:33,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0eb83371ca7f933a443084a2f1693f8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:33,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326073886"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326073886"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326073886"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326073886"}]},"ts":"1689326073886"} 2023-07-14 09:14:33,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:33,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8ce8fbc966881de1e2a3cba42aea1157, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:33,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326073888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326073888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326073888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326073888"}]},"ts":"1689326073888"} 2023-07-14 09:14:33,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-14 09:14:33,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0eb83371ca7f933a443084a2f1693f8e, server=jenkins-hbase9.apache.org,38061,1689325950049 in 175 msec 2023-07-14 09:14:33,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-14 09:14:33,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 8ce8fbc966881de1e2a3cba42aea1157, server=jenkins-hbase9.apache.org,42505,1689325949776 in 178 msec 2023-07-14 09:14:33,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, ASSIGN in 341 msec 2023-07-14 09:14:33,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-14 09:14:33,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, ASSIGN in 342 msec 2023-07-14 09:14:33,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:33,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326073897"}]},"ts":"1689326073897"} 2023-07-14 09:14:33,898 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 09:14:33,901 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:33,901 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 09:14:33,905 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:14:33,907 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,907 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,907 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,907 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:33,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,909 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:33,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 457 msec 2023-07-14 09:14:34,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 09:14:34,066 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 09:14:34,066 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 09:14:34,066 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:34,070 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 09:14:34,070 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:34,070 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-14 09:14:34,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326074076 (current time:1689326074076). 2023-07-14 09:14:34,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:34,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x545090f9 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:34,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d56635f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:34,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,096 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x545090f9 to 127.0.0.1:63612 2023-07-14 09:14:34,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:34,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x71179e9b to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:34,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21901f18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:34,112 DEBUG [hconnection-0xf72ccee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,116 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,125 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71179e9b to 127.0.0.1:63612 2023-07-14 09:14:34,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:34,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:14:34,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:34,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,131 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,132 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326674132 2023-07-14 09:14:34,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:34,134 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:34,134 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:34,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,137 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-14 09:14:34,143 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,144 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326674143 2023-07-14 09:14:34,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,158 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 09:14:34,158 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,160 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 09:14:34,160 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:14:34,160 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,161 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,165 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,165 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,165 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,165 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,165 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,165 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,166 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,166 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:34,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:34,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,170 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:34,170 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,175 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:34,175 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:34,176 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,175 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:34,177 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:34,177 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:34,177 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:34,175 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,177 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:34,177 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:34,178 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:34,178 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:34,178 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:34,181 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,181 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,181 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,182 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,182 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,182 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:34,183 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,183 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,183 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:34,183 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,183 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:34,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:34,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55493e4d[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:34,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:34,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55493e4d[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:34,191 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:14:34,191 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,194 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:34,197 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:34,197 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:34,197 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:34,197 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:34,197 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:34,198 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:34,198 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,198 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:34,198 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:34,198 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. started... 2023-07-14 09:14:34,198 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:34,200 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,202 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:34,200 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:34,202 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. started... 2023-07-14 09:14:34,202 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,202 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:34,202 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ce8fbc966881de1e2a3cba42aea1157: 2023-07-14 09:14:34,203 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,203 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:34,203 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:34,206 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0eb83371ca7f933a443084a2f1693f8e: 2023-07-14 09:14:34,206 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,206 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:34,206 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:34,230 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. completed. 2023-07-14 09:14:34,230 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:34,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:34,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:34,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:34,230 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:34,232 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:34,232 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,232 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,232 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:34,234 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:34,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,235 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. completed. 2023-07-14 09:14:34,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,235 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:34,235 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:34,235 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:34,235 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,235 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:34,235 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:34,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:34,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:34,236 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:34,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,237 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,237 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:34,238 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,238 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:14:34,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:14:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:34,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:14:34,254 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 09:14:34,254 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:34,254 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:34,254 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,254 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:34,256 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,256 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,256 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,256 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,256 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,257 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,258 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,259 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,259 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,259 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,263 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,263 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,264 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,270 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,270 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,270 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,270 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,271 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,271 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,273 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,273 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,273 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,273 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,274 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,274 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,407 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 09:14:34,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,408 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689326074132Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689326074273 (+141 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689326074273Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689326074291 (+18 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689326074317 (+26 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689326074407 (+90 ms) 2023-07-14 09:14:34,412 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 280 msec 2023-07-14 09:14:34,436 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:34,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:34,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:34,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:34,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42505] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:34,455 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:34,455 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:34,456 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:34,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326074470 (current time:1689326074470). 2023-07-14 09:14:34,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:34,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x2e170401 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:34,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371bb891, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:34,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,494 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e170401 to 127.0.0.1:63612 2023-07-14 09:14:34,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:34,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x0f61d7ee to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:34,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1940ed0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:34,514 DEBUG [hconnection-0x73f50186-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,515 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:34,521 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:34,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f61d7ee to 127.0.0.1:63612 2023-07-14 09:14:34,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:34,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 09:14:34,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:34,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,531 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,533 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689326674533 2023-07-14 09:14:34,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 09:14:34,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:34,534 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:34,534 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:34,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,537 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 09:14:34,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-14 09:14:34,541 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,543 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689326674543 2023-07-14 09:14:34,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,558 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 09:14:34,558 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,559 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 09:14:34,559 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 09:14:34,560 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,560 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,561 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,561 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,561 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,561 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,562 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,562 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,563 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,563 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 09:14:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 09:14:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,563 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:34,563 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:34,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,564 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:34,564 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,564 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:34,567 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,567 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:34,569 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:34,568 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:34,569 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 09:14:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,569 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:34,569 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:34,569 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 09:14:34,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,569 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 09:14:34,570 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:34,573 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 09:14:34,573 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 09:14:34,573 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 09:14:34,575 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,575 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,576 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,576 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6b9bff[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 09:14:34,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6b9bff[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:34,581 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 09:14:34,582 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:34,587 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:34,587 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:34,587 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,587 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. started... 2023-07-14 09:14:34,587 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:34,587 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. started... 2023-07-14 09:14:34,588 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,588 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:34,588 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0eb83371ca7f933a443084a2f1693f8e 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 09:14:34,588 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8ce8fbc966881de1e2a3cba42aea1157 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 09:14:34,592 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:34,592 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,592 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:34,619 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/.tmp/cf/8eedd00e3a644e919fa51812effa425f 2023-07-14 09:14:34,623 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/.tmp/cf/fcd58548ba1e46baa73913c00b9db39b 2023-07-14 09:14:34,628 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/.tmp/cf/8eedd00e3a644e919fa51812effa425f as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf/8eedd00e3a644e919fa51812effa425f 2023-07-14 09:14:34,630 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/.tmp/cf/fcd58548ba1e46baa73913c00b9db39b as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf/fcd58548ba1e46baa73913c00b9db39b 2023-07-14 09:14:34,634 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf/8eedd00e3a644e919fa51812effa425f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 09:14:34,635 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:34,635 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0eb83371ca7f933a443084a2f1693f8e in 47ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:34,635 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 09:14:34,635 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf/fcd58548ba1e46baa73913c00b9db39b, entries=47, sequenceid=6, filesize=8.0 K 2023-07-14 09:14:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:34,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:34,636 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0eb83371ca7f933a443084a2f1693f8e: 2023-07-14 09:14:34,636 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:34,636 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,636 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8ce8fbc966881de1e2a3cba42aea1157 in 48ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:34,637 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:34,638 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8ce8fbc966881de1e2a3cba42aea1157: 2023-07-14 09:14:34,638 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf/8eedd00e3a644e919fa51812effa425f] hfiles 2023-07-14 09:14:34,638 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf/8eedd00e3a644e919fa51812effa425f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,639 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,640 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:34,640 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf/fcd58548ba1e46baa73913c00b9db39b] hfiles 2023-07-14 09:14:34,640 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf/fcd58548ba1e46baa73913c00b9db39b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,674 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. completed. 2023-07-14 09:14:34,674 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:34,674 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:34,674 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:34,674 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,674 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:34,674 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:34,676 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,676 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,676 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,677 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,679 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. completed. 2023-07-14 09:14:34,679 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:34,679 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:34,680 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,680 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,680 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 09:14:34,680 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,681 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 09:14:34,681 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,681 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,681 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 09:14:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:34,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 09:14:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:14:34,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 09:14:34,696 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 09:14:34,696 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:34,696 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:34,696 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,696 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:34,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,699 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:34,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,703 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,704 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,711 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,711 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:34,712 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,719 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,719 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,719 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,720 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:34,720 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,721 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,721 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:34,721 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,722 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:34,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:34,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,837 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:34,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:34,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:34,839 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:34,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 09:14:34,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,854 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:34,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689326074533Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689326074721 (+188 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689326074722 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689326074728 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689326074760 (+32 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689326074854 (+94 ms) 2023-07-14 09:14:34,860 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 09:14:34,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 326 msec 2023-07-14 09:14:35,139 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:35,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 09:14:35,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:35,141 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141 2023-07-14 09:14:35,141 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43917, tgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141, rawTgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:14:35,169 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:14:35,169 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1739515598_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,169 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 09:14:35,184 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:35,273 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,274 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,275 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,275 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,275 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,276 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,276 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,362 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-439420903816375064.jar 2023-07-14 09:14:35,363 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,363 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,363 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,363 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,364 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,364 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:35,364 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:14:35,365 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:14:35,366 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:14:35,366 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:14:35,367 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:14:35,367 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:14:35,368 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:14:35,369 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:14:35,369 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:14:35,370 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:14:35,370 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:35,370 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:35,371 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:35,371 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:35,371 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:35,372 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:35,372 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:36,442 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:14:36,445 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 09:14:36,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0005_000001 (auth:SIMPLE) 2023-07-14 09:14:36,609 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:36,609 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:36,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0006_000001 (auth:SIMPLE) 2023-07-14 09:14:38,032 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:43,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0006_000001 (auth:SIMPLE) 2023-07-14 09:14:45,958 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:14:45,959 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:14:45,987 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:45,987 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:14:45,988 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:14:45,988 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:45,989 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 09:14:45,989 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 09:14:45,989 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:45,989 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 09:14:45,989 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326075141/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 09:14:45,995 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 09:14:45,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 09:14:45,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 09:14:46,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326086005"}]},"ts":"1689326086005"} 2023-07-14 09:14:46,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 09:14:46,009 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 09:14:46,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, UNASSIGN}] 2023-07-14 09:14:46,013 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, UNASSIGN 2023-07-14 09:14:46,013 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, UNASSIGN 2023-07-14 09:14:46,014 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0eb83371ca7f933a443084a2f1693f8e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:46,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8ce8fbc966881de1e2a3cba42aea1157, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:46,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326086014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326086014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326086014"}]},"ts":"1689326086014"} 2023-07-14 09:14:46,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326086014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326086014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326086014"}]},"ts":"1689326086014"} 2023-07-14 09:14:46,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0eb83371ca7f933a443084a2f1693f8e, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:46,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 8ce8fbc966881de1e2a3cba42aea1157, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:46,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 09:14:46,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:46,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:46,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0eb83371ca7f933a443084a2f1693f8e, disabling compactions & flushes 2023-07-14 09:14:46,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8ce8fbc966881de1e2a3cba42aea1157, disabling compactions & flushes 2023-07-14 09:14:46,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:46,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:46,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:46,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. after waiting 0 ms 2023-07-14 09:14:46,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:46,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:46,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. after waiting 0 ms 2023-07-14 09:14:46,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:46,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:46,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:46,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e. 2023-07-14 09:14:46,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0eb83371ca7f933a443084a2f1693f8e: 2023-07-14 09:14:46,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:46,277 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0eb83371ca7f933a443084a2f1693f8e, regionState=CLOSED 2023-07-14 09:14:46,277 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326086277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326086277"}]},"ts":"1689326086277"} 2023-07-14 09:14:46,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:14:46,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:14:46,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157. 2023-07-14 09:14:46,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8ce8fbc966881de1e2a3cba42aea1157: 2023-07-14 09:14:46,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:46,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8ce8fbc966881de1e2a3cba42aea1157, regionState=CLOSED 2023-07-14 09:14:46,282 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689326086282"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326086282"}]},"ts":"1689326086282"} 2023-07-14 09:14:46,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 09:14:46,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0eb83371ca7f933a443084a2f1693f8e, server=jenkins-hbase9.apache.org,38061,1689325950049 in 265 msec 2023-07-14 09:14:46,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0eb83371ca7f933a443084a2f1693f8e, UNASSIGN in 273 msec 2023-07-14 09:14:46,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 09:14:46,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 8ce8fbc966881de1e2a3cba42aea1157, server=jenkins-hbase9.apache.org,42505,1689325949776 in 267 msec 2023-07-14 09:14:46,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 09:14:46,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8ce8fbc966881de1e2a3cba42aea1157, UNASSIGN in 275 msec 2023-07-14 09:14:46,299 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326086299"}]},"ts":"1689326086299"} 2023-07-14 09:14:46,301 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 09:14:46,303 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 09:14:46,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 308 msec 2023-07-14 09:14:46,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 09:14:46,313 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 09:14:46,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,321 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,322 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,324 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,327 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,327 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,327 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,328 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:46,328 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:46,331 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:46,331 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:46,334 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:46,334 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 09:14:46,336 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,336 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:46,337 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,337 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:46,337 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/recovered.edits] 2023-07-14 09:14:46,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 09:14:46,338 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,338 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,338 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:46,338 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:46,343 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf/fcd58548ba1e46baa73913c00b9db39b to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/cf/fcd58548ba1e46baa73913c00b9db39b 2023-07-14 09:14:46,348 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157/recovered.edits/9.seqid 2023-07-14 09:14:46,350 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/recovered.edits] 2023-07-14 09:14:46,351 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/8ce8fbc966881de1e2a3cba42aea1157 2023-07-14 09:14:46,356 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf/8eedd00e3a644e919fa51812effa425f to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/cf/8eedd00e3a644e919fa51812effa425f 2023-07-14 09:14:46,360 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e/recovered.edits/9.seqid 2023-07-14 09:14:46,361 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testEmptyExportFileSystemState/0eb83371ca7f933a443084a2f1693f8e 2023-07-14 09:14:46,361 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 09:14:46,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,369 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 09:14:46,400 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 09:14:46,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 09:14:46,401 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326086401"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:46,402 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326086401"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:46,404 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:14:46,404 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0eb83371ca7f933a443084a2f1693f8e, NAME => 'testtb-testEmptyExportFileSystemState,,1689326073451.0eb83371ca7f933a443084a2f1693f8e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8ce8fbc966881de1e2a3cba42aea1157, NAME => 'testtb-testEmptyExportFileSystemState,1,1689326073451.8ce8fbc966881de1e2a3cba42aea1157.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:14:46,404 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 09:14:46,405 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326086404"}]},"ts":"9223372036854775807"} 2023-07-14 09:14:46,406 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 09:14:46,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 09:14:46,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 95 msec 2023-07-14 09:14:46,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 09:14:46,440 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 09:14:46,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 09:14:46,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:46,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 09:14:46,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 09:14:46,586 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:38320 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:35707 from appattempt_1689325960596_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1493748829_1 at /127.0.0.1:36414 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4837 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x16882c96-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase9.apache.org/172.31.2.10:46533 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:50662 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_662687993_17 at /127.0.0.1:36446 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16882c96-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=950 (was 986), ProcessCount=190 (was 190), AvailableMemoryMB=2435 (was 2444) 2023-07-14 09:14:46,587 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-14 09:14:46,660 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=950, ProcessCount=190, AvailableMemoryMB=2433 2023-07-14 09:14:46,660 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-14 09:14:46,662 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 09:14:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:46,671 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 09:14:46,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 09:14:46,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:46,673 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 09:14:46,677 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:46,677 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:46,678 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 empty. 2023-07-14 09:14:46,679 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f empty. 2023-07-14 09:14:46,679 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:46,681 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:46,681 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 09:14:46,757 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 09:14:46,771 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 445183bc7defe448b73ad44d0b852476, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:46,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:46,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 015ebe985de3671fc0045d1e49c4683f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp 2023-07-14 09:14:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:46,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:46,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 445183bc7defe448b73ad44d0b852476, disabling compactions & flushes 2023-07-14 09:14:46,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:46,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:46,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. after waiting 0 ms 2023-07-14 09:14:46,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:46,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:46,976 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 445183bc7defe448b73ad44d0b852476: 2023-07-14 09:14:46,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:46,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 015ebe985de3671fc0045d1e49c4683f, disabling compactions & flushes 2023-07-14 09:14:46,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:46,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:46,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. after waiting 0 ms 2023-07-14 09:14:46,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:46,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:46,995 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 015ebe985de3671fc0045d1e49c4683f: 2023-07-14 09:14:47,000 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 09:14:47,002 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326087002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326087002"}]},"ts":"1689326087002"} 2023-07-14 09:14:47,002 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326087002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326087002"}]},"ts":"1689326087002"} 2023-07-14 09:14:47,008 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 09:14:47,009 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 09:14:47,009 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326087009"}]},"ts":"1689326087009"} 2023-07-14 09:14:47,015 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 09:14:47,019 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 09:14:47,021 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 09:14:47,021 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 09:14:47,021 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 09:14:47,021 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 09:14:47,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, ASSIGN}] 2023-07-14 09:14:47,025 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, ASSIGN 2023-07-14 09:14:47,026 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, ASSIGN 2023-07-14 09:14:47,027 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38061,1689325950049; forceNewPlan=false, retain=false 2023-07-14 09:14:47,027 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,42505,1689325949776; forceNewPlan=false, retain=false 2023-07-14 09:14:47,177 INFO [jenkins-hbase9:35455] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 09:14:47,182 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=445183bc7defe448b73ad44d0b852476, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326087182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326087182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326087182"}]},"ts":"1689326087182"} 2023-07-14 09:14:47,183 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=015ebe985de3671fc0045d1e49c4683f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,183 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326087183"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326087183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326087183"}]},"ts":"1689326087183"} 2023-07-14 09:14:47,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 445183bc7defe448b73ad44d0b852476, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:14:47,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 015ebe985de3671fc0045d1e49c4683f, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:14:47,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:47,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:47,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 445183bc7defe448b73ad44d0b852476, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 09:14:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 015ebe985de3671fc0045d1e49c4683f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 09:14:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. service=AccessControlService 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. service=AccessControlService 2023-07-14 09:14:47,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 09:14:47,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,354 INFO [StoreOpener-015ebe985de3671fc0045d1e49c4683f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,356 DEBUG [StoreOpener-015ebe985de3671fc0045d1e49c4683f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf 2023-07-14 09:14:47,356 DEBUG [StoreOpener-015ebe985de3671fc0045d1e49c4683f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf 2023-07-14 09:14:47,356 INFO [StoreOpener-015ebe985de3671fc0045d1e49c4683f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 015ebe985de3671fc0045d1e49c4683f columnFamilyName cf 2023-07-14 09:14:47,357 INFO [StoreOpener-015ebe985de3671fc0045d1e49c4683f-1] regionserver.HStore(310): Store=015ebe985de3671fc0045d1e49c4683f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:47,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:14:47,366 INFO [StoreOpener-445183bc7defe448b73ad44d0b852476-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,378 DEBUG [StoreOpener-445183bc7defe448b73ad44d0b852476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf 2023-07-14 09:14:47,378 DEBUG [StoreOpener-445183bc7defe448b73ad44d0b852476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf 2023-07-14 09:14:47,378 INFO [StoreOpener-445183bc7defe448b73ad44d0b852476-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 445183bc7defe448b73ad44d0b852476 columnFamilyName cf 2023-07-14 09:14:47,379 INFO [StoreOpener-445183bc7defe448b73ad44d0b852476-1] regionserver.HStore(310): Store=445183bc7defe448b73ad44d0b852476/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 09:14:47,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:47,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 015ebe985de3671fc0045d1e49c4683f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70327851, jitterRate=0.047966644167900085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:47,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 015ebe985de3671fc0045d1e49c4683f: 2023-07-14 09:14:47,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f., pid=109, masterSystemTime=1689326087338 2023-07-14 09:14:47,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 445183bc7defe448b73ad44d0b852476 2023-07-14 09:14:47,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:47,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:47,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=015ebe985de3671fc0045d1e49c4683f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,392 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326087386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326087386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326087386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326087386"}]},"ts":"1689326087386"} 2023-07-14 09:14:47,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 09:14:47,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 445183bc7defe448b73ad44d0b852476; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74375556, jitterRate=0.10828214883804321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 09:14:47,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 445183bc7defe448b73ad44d0b852476: 2023-07-14 09:14:47,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476., pid=108, masterSystemTime=1689326087338 2023-07-14 09:14:47,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-14 09:14:47,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 015ebe985de3671fc0045d1e49c4683f, server=jenkins-hbase9.apache.org,38061,1689325950049 in 208 msec 2023-07-14 09:14:47,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:47,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:47,405 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=445183bc7defe448b73ad44d0b852476, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, ASSIGN in 383 msec 2023-07-14 09:14:47,406 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326087405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689326087405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689326087405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689326087405"}]},"ts":"1689326087405"} 2023-07-14 09:14:47,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-14 09:14:47,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 445183bc7defe448b73ad44d0b852476, server=jenkins-hbase9.apache.org,42505,1689325949776 in 223 msec 2023-07-14 09:14:47,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-14 09:14:47,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, ASSIGN in 389 msec 2023-07-14 09:14:47,418 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 09:14:47,418 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326087418"}]},"ts":"1689326087418"} 2023-07-14 09:14:47,420 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 09:14:47,423 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 09:14:47,424 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 09:14:47,426 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 09:14:47,428 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:47,428 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:47,428 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:47,428 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:14:47,437 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:47,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:47,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:47,438 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 09:14:47,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 767 msec 2023-07-14 09:14:47,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 09:14:47,779 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 09:14:47,779 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-14 09:14:47,779 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:47,784 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-14 09:14:47,784 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:47,784 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-14 09:14:47,787 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:47,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326087787 (current time:1689326087787). 2023-07-14 09:14:47,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:47,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x069a5212 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:47,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61698553, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:47,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:47,807 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:47,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x069a5212 to 127.0.0.1:63612 2023-07-14 09:14:47,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:47,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x30dc2e35 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6482e0fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:47,830 DEBUG [hconnection-0x49ecb220-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:47,834 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:47,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:47,845 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30dc2e35 to 127.0.0.1:63612 2023-07-14 09:14:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 09:14:47,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:47,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:47,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:47,854 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:47,855 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689326687855 2023-07-14 09:14:47,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:47,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,856 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:47,856 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:47,857 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:47,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:47,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-14 09:14:47,859 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:47,859 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689326687859 2023-07-14 09:14:47,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,882 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 09:14:47,882 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:47,883 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 09:14:47,883 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 09:14:47,884 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,884 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:47,885 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:47,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:47,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:47,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:47,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:47,885 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:47,885 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,886 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,886 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:47,887 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 09:14:47,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:47,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,890 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:47,890 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:47,893 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:47,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,894 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:47,894 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:47,893 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:47,895 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:47,895 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:47,894 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:47,895 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:47,895 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:47,895 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:47,896 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:47,896 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:47,896 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:47,908 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,908 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,908 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,908 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:47,909 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,909 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:47,909 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,909 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,910 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,911 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,911 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:47,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:47,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@427b6859[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:47,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:47,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:47,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:47,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:47,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:47,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:47,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@427b6859[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:47,923 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 09:14:47,923 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:47,925 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:47,925 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:47,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:47,925 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:47,925 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:47,925 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. started... 2023-07-14 09:14:47,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,925 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:47,926 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:47,925 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:47,927 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 015ebe985de3671fc0045d1e49c4683f: 2023-07-14 09:14:47,927 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,928 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:47,927 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:47,926 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. started... 2023-07-14 09:14:47,928 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,928 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:47,929 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 445183bc7defe448b73ad44d0b852476: 2023-07-14 09:14:47,928 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:47,929 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:47,929 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,929 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:47,929 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 09:14:47,931 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:47,931 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:47,931 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:47,950 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. completed. 2023-07-14 09:14:47,950 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:47,950 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:47,950 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:47,950 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,953 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:47,954 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:47,955 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:47,955 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,955 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:47,955 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:47,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:47,956 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:47,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:47,957 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,962 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. completed. 2023-07-14 09:14:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:47,962 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:47,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 09:14:47,963 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:47,963 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:47,963 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,963 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:47,963 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:47,964 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,964 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:47,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:47,965 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:47,965 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:47,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:47,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:14:47,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 09:14:47,979 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 09:14:47,979 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:47,979 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:47,979 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,979 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:47,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:47,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,981 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:47,982 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:47,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:47,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,983 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,984 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:47,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,986 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:47,986 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,987 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,991 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:47,991 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:47,991 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:47,991 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:47,992 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:47,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:47,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:47,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:47,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:47,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:47,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:47,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:47,994 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:47,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:47,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:47,994 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,996 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:47,996 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:47,996 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,997 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:47,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 09:14:48,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689326087855Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326087994 (+139 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326087994Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326088017 (+23 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689326088050 (+33 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689326088141 (+91 ms) 2023-07-14 09:14:48,145 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:48,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 289 msec 2023-07-14 09:14:48,159 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:48,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:48,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:48,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42505] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:48,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38061] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 09:14:48,232 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,232 DEBUG [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:48,232 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 09:14:48,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:48,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689326088259 (current time:1689326088259). 2023-07-14 09:14:48,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 09:14:48,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x4764f13c to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:48,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b352642, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:48,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:48,291 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:48,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4764f13c to 127.0.0.1:63612 2023-07-14 09:14:48,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:48,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(139): Connect 0x5b4137f1 to 127.0.0.1:63612 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 09:14:48,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b4cd0b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 09:14:48,407 DEBUG [hconnection-0x7909e6a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:48,413 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:48,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 09:14:48,421 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 09:14:48,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b4137f1 to 127.0.0.1:63612 2023-07-14 09:14:48,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:14:48,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 09:14:48,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 09:14:48,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:48,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:48,431 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:48,432 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689326688432 2023-07-14 09:14:48,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 09:14:48,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,434 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 09:14:48,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-14 09:14:48,443 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 09:14:48,443 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 09:14:48,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:48,446 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:48,446 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689326688446 2023-07-14 09:14:48,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,508 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 09:14:48,508 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:48,510 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 09:14:48,510 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 09:14:48,530 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,530 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,531 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:48,531 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:48,531 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,531 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:48,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:48,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:48,532 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,532 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,533 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,533 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 09:14:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,534 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:48,534 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:48,534 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 09:14:48,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,534 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:48,534 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:48,543 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:48,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:48,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:48,544 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 09:14:48,551 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:48,551 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:48,551 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:48,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,552 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:48,552 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 09:14:48,552 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:48,552 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 09:14:48,553 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:48,554 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:48,554 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:48,559 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 09:14:48,559 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 09:14:48,559 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,41907,1689325949930' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 09:14:48,560 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,560 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:48,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:48,560 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,560 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:48,561 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:48,561 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,561 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:48,562 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,562 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:48,562 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,562 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 09:14:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:48,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,42505,1689325949776' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:48,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68756c7[Count = 1] remaining members to acquire global barrier 2023-07-14 09:14:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:48,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38061,1689325950049' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 09:14:48,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68756c7[Count = 0] remaining members to acquire global barrier 2023-07-14 09:14:48,567 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 09:14:48,567 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,572 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:48,572 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:48,573 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 09:14:48,573 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,41907,1689325949930' in zk 2023-07-14 09:14:48,573 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,573 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 09:14:48,573 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:48,573 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:48,573 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:48,573 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 09:14:48,573 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 09:14:48,573 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:48,573 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. started... 2023-07-14 09:14:48,573 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. started... 2023-07-14 09:14:48,573 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 445183bc7defe448b73ad44d0b852476 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 09:14:48,574 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 015ebe985de3671fc0045d1e49c4683f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 09:14:48,574 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:48,574 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:48,574 DEBUG [member: 'jenkins-hbase9.apache.org,41907,1689325949930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:48,616 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/.tmp/cf/28bbc44ccadf4d66b6c089dcf164cbb3 2023-07-14 09:14:48,623 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/.tmp/cf/28bbc44ccadf4d66b6c089dcf164cbb3 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf/28bbc44ccadf4d66b6c089dcf164cbb3 2023-07-14 09:14:48,633 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf/28bbc44ccadf4d66b6c089dcf164cbb3, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 09:14:48,634 INFO [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 445183bc7defe448b73ad44d0b852476 in 61ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:48,634 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 09:14:48,635 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 445183bc7defe448b73ad44d0b852476: 2023-07-14 09:14:48,635 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,635 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:48,635 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf/28bbc44ccadf4d66b6c089dcf164cbb3] hfiles 2023-07-14 09:14:48,635 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf/28bbc44ccadf4d66b6c089dcf164cbb3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,686 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/.tmp/cf/020d1cb07d944be995e3fc8c9feda376 2023-07-14 09:14:48,698 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/.tmp/cf/020d1cb07d944be995e3fc8c9feda376 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf/020d1cb07d944be995e3fc8c9feda376 2023-07-14 09:14:48,745 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:48,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:48,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 09:14:48,746 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 09:14:48,768 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. completed. 2023-07-14 09:14:48,768 DEBUG [rs(jenkins-hbase9.apache.org,42505,1689325949776)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:14:48,768 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:48,768 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:48,768 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,768 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:48,768 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,42505,1689325949776' in zk 2023-07-14 09:14:48,771 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf/020d1cb07d944be995e3fc8c9feda376, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 09:14:48,771 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:48,771 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,771 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:48,772 DEBUG [member: 'jenkins-hbase9.apache.org,42505,1689325949776' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:48,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:48,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:48,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:48,775 INFO [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 015ebe985de3671fc0045d1e49c4683f in 201ms, sequenceid=6, compaction requested=false 2023-07-14 09:14:48,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:48,777 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 015ebe985de3671fc0045d1e49c4683f: 2023-07-14 09:14:48,777 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,777 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 09:14:48,777 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf/020d1cb07d944be995e3fc8c9feda376] hfiles 2023-07-14 09:14:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,777 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf/020d1cb07d944be995e3fc8c9feda376 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:48,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,42505,1689325949776': 2023-07-14 09:14:48,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,42505,1689325949776' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 09:14:48,852 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. completed. 2023-07-14 09:14:48,852 DEBUG [rs(jenkins-hbase9.apache.org,38061,1689325950049)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:14:48,852 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 09:14:48,852 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 09:14:48,852 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,852 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 09:14:48,853 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,38061,1689325950049' in zk 2023-07-14 09:14:48,855 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,855 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 09:14:48,855 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:48,855 DEBUG [member: 'jenkins-hbase9.apache.org,38061,1689325950049' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 09:14:48,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:48,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:48,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:48,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:48,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:48,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,38061,1689325950049': 2023-07-14 09:14:48,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38061,1689325950049' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 09:14:48,863 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 09:14:48,863 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 09:14:48,863 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 09:14:48,863 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,863 INFO [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:48,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:48,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 09:14:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 09:14:48,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 09:14:48,868 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:48,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:48,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,874 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 09:14:48,875 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,880 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 09:14:48,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,880 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,881 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:48,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,885 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:48,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:48,886 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:48,886 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:48,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:48,886 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 09:14:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:48,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 09:14:48,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,886 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 09:14:48,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 09:14:48,886 DEBUG [(jenkins-hbase9.apache.org,35455,1689325948029)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 09:14:48,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:48,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:48,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 09:14:48,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 09:14:48,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 09:14:48,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,955 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:48,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689326088433Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689326088886 (+453 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689326088887 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689326088893 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689326088913 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689326088954 (+41 ms) 2023-07-14 09:14:48,959 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 09:14:48,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 525 msec 2023-07-14 09:14:49,046 DEBUG [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 09:14:49,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 09:14:49,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 09:14:49,048 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048 2023-07-14 09:14:49,048 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43917, tgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048, rawTgtDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048, srcFsUri=hdfs://localhost:43917, srcDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:14:49,078 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6 2023-07-14 09:14:49,079 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1915574297_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:49,079 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43917, inputRoot=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6, snapshotDir=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 09:14:49,101 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:14:49,166 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,166 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,167 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,167 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,167 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,168 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,168 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,258 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/hadoop-136550849212562116.jar 2023-07-14 09:14:49,259 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,259 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,259 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,260 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,260 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,260 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 09:14:49,261 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 09:14:49,261 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 09:14:49,261 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 09:14:49,262 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 09:14:49,262 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 09:14:49,262 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 09:14:49,263 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 09:14:49,263 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 09:14:49,263 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 09:14:49,264 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 09:14:49,264 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:49,265 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:49,265 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:49,265 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:49,265 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 09:14:49,266 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:49,266 DEBUG [Listener at jenkins-hbase9.apache.org/45963] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 09:14:50,116 WARN [Listener at jenkins-hbase9.apache.org/45963] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 09:14:50,118 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 09:14:50,120 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 09:14:50,917 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:50,917 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 09:14:50,923 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0006_000001 (auth:SIMPLE) 2023-07-14 09:14:51,491 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0007_000001 (auth:SIMPLE) 2023-07-14 09:14:51,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:14:57,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0007_000001 (auth:SIMPLE) 2023-07-14 09:14:59,891 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:06,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:08,366 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 09:15:08,367 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 09:15:08,396 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,397 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 09:15:08,402 INFO [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 09:15:08,402 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,403 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 09:15:08,403 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 09:15:08,403 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_662687993_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,404 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 09:15:08,404 DEBUG [Listener at jenkins-hbase9.apache.org/45963] snapshot.TestExportSnapshot(367): hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/export-test/export-1689326089048/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 09:15:08,415 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 09:15:08,424 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326108423"}]},"ts":"1689326108423"} 2023-07-14 09:15:08,431 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 09:15:08,433 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 09:15:08,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, UNASSIGN}] 2023-07-14 09:15:08,435 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, UNASSIGN 2023-07-14 09:15:08,437 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, UNASSIGN 2023-07-14 09:15:08,438 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=445183bc7defe448b73ad44d0b852476, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:15:08,439 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326108438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326108438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326108438"}]},"ts":"1689326108438"} 2023-07-14 09:15:08,439 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=015ebe985de3671fc0045d1e49c4683f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:15:08,439 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326108439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689326108439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689326108439"}]},"ts":"1689326108439"} 2023-07-14 09:15:08,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 445183bc7defe448b73ad44d0b852476, server=jenkins-hbase9.apache.org,42505,1689325949776}] 2023-07-14 09:15:08,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 015ebe985de3671fc0045d1e49c4683f, server=jenkins-hbase9.apache.org,38061,1689325950049}] 2023-07-14 09:15:08,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 09:15:08,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 445183bc7defe448b73ad44d0b852476 2023-07-14 09:15:08,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 445183bc7defe448b73ad44d0b852476, disabling compactions & flushes 2023-07-14 09:15:08,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:15:08,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:15:08,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. after waiting 0 ms 2023-07-14 09:15:08,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:15:08,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:15:08,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 015ebe985de3671fc0045d1e49c4683f, disabling compactions & flushes 2023-07-14 09:15:08,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:15:08,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:15:08,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. after waiting 0 ms 2023-07-14 09:15:08,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:15:08,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:15:08,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:08,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476. 2023-07-14 09:15:08,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 445183bc7defe448b73ad44d0b852476: 2023-07-14 09:15:08,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:15:08,629 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 445183bc7defe448b73ad44d0b852476 2023-07-14 09:15:08,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:08,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f. 2023-07-14 09:15:08,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 015ebe985de3671fc0045d1e49c4683f: 2023-07-14 09:15:08,630 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=445183bc7defe448b73ad44d0b852476, regionState=CLOSED 2023-07-14 09:15:08,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326108629"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326108629"}]},"ts":"1689326108629"} 2023-07-14 09:15:08,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:15:08,636 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=015ebe985de3671fc0045d1e49c4683f, regionState=CLOSED 2023-07-14 09:15:08,636 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689326108636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689326108636"}]},"ts":"1689326108636"} 2023-07-14 09:15:08,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 09:15:08,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 445183bc7defe448b73ad44d0b852476, server=jenkins-hbase9.apache.org,42505,1689325949776 in 195 msec 2023-07-14 09:15:08,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 09:15:08,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 015ebe985de3671fc0045d1e49c4683f, server=jenkins-hbase9.apache.org,38061,1689325950049 in 197 msec 2023-07-14 09:15:08,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=445183bc7defe448b73ad44d0b852476, UNASSIGN in 206 msec 2023-07-14 09:15:08,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-14 09:15:08,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=015ebe985de3671fc0045d1e49c4683f, UNASSIGN in 207 msec 2023-07-14 09:15:08,644 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689326108643"}]},"ts":"1689326108643"} 2023-07-14 09:15:08,646 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 09:15:08,712 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 09:15:08,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 297 msec 2023-07-14 09:15:08,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 09:15:08,723 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 09:15:08,723 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,726 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,727 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,730 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38061] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,735 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 2023-07-14 09:15:08,735 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:15:08,737 DEBUG [HFileArchiver-24] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/recovered.edits] 2023-07-14 09:15:08,737 DEBUG [HFileArchiver-25] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf, FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/recovered.edits] 2023-07-14 09:15:08,740 DEBUG [HFileArchiver-24] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf/28bbc44ccadf4d66b6c089dcf164cbb3 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/cf/28bbc44ccadf4d66b6c089dcf164cbb3 2023-07-14 09:15:08,741 DEBUG [HFileArchiver-25] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf/020d1cb07d944be995e3fc8c9feda376 to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/cf/020d1cb07d944be995e3fc8c9feda376 2023-07-14 09:15:08,744 DEBUG [HFileArchiver-24] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476/recovered.edits/9.seqid 2023-07-14 09:15:08,744 DEBUG [HFileArchiver-25] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/recovered.edits/9.seqid to hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f/recovered.edits/9.seqid 2023-07-14 09:15:08,744 DEBUG [HFileArchiver-24] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/445183bc7defe448b73ad44d0b852476 2023-07-14 09:15:08,744 DEBUG [HFileArchiver-25] backup.HFileArchiver(596): Deleted hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/015ebe985de3671fc0045d1e49c4683f 2023-07-14 09:15:08,745 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 09:15:08,747 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,748 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 09:15:08,750 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 09:15:08,751 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,751 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 09:15:08,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326108751"}]},"ts":"9223372036854775807"} 2023-07-14 09:15:08,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689326108751"}]},"ts":"9223372036854775807"} 2023-07-14 09:15:08,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 09:15:08,753 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 445183bc7defe448b73ad44d0b852476, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689326086662.445183bc7defe448b73ad44d0b852476.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 015ebe985de3671fc0045d1e49c4683f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689326086662.015ebe985de3671fc0045d1e49c4683f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 09:15:08,753 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 09:15:08,753 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689326108753"}]},"ts":"9223372036854775807"} 2023-07-14 09:15:08,756 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 09:15:08,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 113 msec 2023-07-14 09:15:08,874 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,874 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,874 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 09:15:08,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 09:15:08,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 09:15:08,874 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,904 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,905 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:08,905 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:08,904 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,905 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 09:15:08,904 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,905 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:08,905 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 09:15:08,905 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 09:15:08,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 09:15:08,906 INFO [Listener at jenkins-hbase9.apache.org/45963] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 09:15:08,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 09:15:08,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,922 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 09:15:08,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35455] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 09:15:08,956 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 765), OpenFileDescriptor=903 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1029 (was 950) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 190), AvailableMemoryMB=1377 (was 2433) 2023-07-14 09:15:08,957 WARN [Listener at jenkins-hbase9.apache.org/45963] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-14 09:15:08,957 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 09:15:09,012 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:12,692 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689325960596_0007_000001 (auth:SIMPLE) 2023-07-14 09:15:14,201 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 09:15:23,060 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:37,181 ERROR [Thread[Thread-412,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 09:15:37,182 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:37,322 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 09:15:37,334 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 09:15:37,335 ERROR [Thread[Thread-422,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 09:15:37,348 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 09:15:37,452 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 09:15:37,452 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 09:15:37,452 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 09:15:37,452 INFO [Listener at jenkins-hbase9.apache.org/45963] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 09:15:37,453 DEBUG [Listener at jenkins-hbase9.apache.org/45963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f8c14a3 to 127.0.0.1:63612 2023-07-14 09:15:37,453 DEBUG [Listener at jenkins-hbase9.apache.org/45963] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,453 DEBUG [Listener at jenkins-hbase9.apache.org/45963] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 09:15:37,453 DEBUG [Listener at jenkins-hbase9.apache.org/45963] util.JVMClusterUtil(257): Found active master hash=2028209117, stopped=false 2023-07-14 09:15:37,453 DEBUG [Listener at jenkins-hbase9.apache.org/45963] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,453 DEBUG [Listener at jenkins-hbase9.apache.org/45963] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 09:15:37,454 INFO [Listener at jenkins-hbase9.apache.org/45963] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:15:37,458 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:37,458 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:37,459 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:37,458 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:15:37,458 INFO [Listener at jenkins-hbase9.apache.org/45963] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 09:15:37,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:37,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:37,459 DEBUG [Listener at jenkins-hbase9.apache.org/45963] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07d32e27 to 127.0.0.1:63612 2023-07-14 09:15:37,459 DEBUG [Listener at jenkins-hbase9.apache.org/45963] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:37,459 INFO [Listener at jenkins-hbase9.apache.org/45963] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,42505,1689325949776' ***** 2023-07-14 09:15:37,460 DEBUG [Listener at jenkins-hbase9.apache.org/45963] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,460 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 09:15:37,460 INFO [Listener at jenkins-hbase9.apache.org/45963] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 09:15:37,461 INFO [Listener at jenkins-hbase9.apache.org/45963] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,41907,1689325949930' ***** 2023-07-14 09:15:37,461 DEBUG [Listener at jenkins-hbase9.apache.org/45963] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,461 INFO [Listener at jenkins-hbase9.apache.org/45963] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 09:15:37,461 INFO [Listener at jenkins-hbase9.apache.org/45963] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38061,1689325950049' ***** 2023-07-14 09:15:37,461 DEBUG [Listener at jenkins-hbase9.apache.org/45963] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,461 INFO [Listener at jenkins-hbase9.apache.org/45963] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 09:15:37,461 INFO [RS:0;jenkins-hbase9:42505] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 09:15:37,461 INFO [RS:1;jenkins-hbase9:41907] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 09:15:37,462 INFO [RS:1;jenkins-hbase9:41907] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 09:15:37,462 INFO [RS:1;jenkins-hbase9:41907] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 09:15:37,462 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 09:15:37,462 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 09:15:37,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 09:15:37,461 INFO [RS:2;jenkins-hbase9:38061] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 09:15:37,464 INFO [RS:2;jenkins-hbase9:38061] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 09:15:37,464 INFO [RS:2;jenkins-hbase9:38061] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 09:15:37,465 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(3305): Received CLOSE for 923b5a133fa8498737d15883785c154a 2023-07-14 09:15:37,465 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:15:37,465 DEBUG [RS:2;jenkins-hbase9:38061] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2509b94a to 127.0.0.1:63612 2023-07-14 09:15:37,465 DEBUG [RS:2;jenkins-hbase9:38061] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,465 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 09:15:37,462 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:15:37,462 INFO [RS:0;jenkins-hbase9:42505] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 09:15:37,466 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 09:15:37,466 DEBUG [RS:1;jenkins-hbase9:41907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bfc9d15 to 127.0.0.1:63612 2023-07-14 09:15:37,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 923b5a133fa8498737d15883785c154a, disabling compactions & flushes 2023-07-14 09:15:37,467 DEBUG [RS:1;jenkins-hbase9:41907] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,466 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1478): Online Regions={923b5a133fa8498737d15883785c154a=hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a.} 2023-07-14 09:15:37,470 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,41907,1689325949930; all regions closed. 2023-07-14 09:15:37,466 INFO [RS:0;jenkins-hbase9:42505] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 09:15:37,469 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:37,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:15:37,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:15:37,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. after waiting 0 ms 2023-07-14 09:15:37,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:15:37,470 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(3305): Received CLOSE for 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:15:37,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 923b5a133fa8498737d15883785c154a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 09:15:37,470 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:15:37,470 DEBUG [RS:0;jenkins-hbase9:42505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26e96a3e to 127.0.0.1:63612 2023-07-14 09:15:37,470 DEBUG [RS:0;jenkins-hbase9:42505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8420ef18efacc28679bf65a4aab0bd8c, disabling compactions & flushes 2023-07-14 09:15:37,471 INFO [RS:0;jenkins-hbase9:42505] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 09:15:37,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:15:37,471 DEBUG [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1504): Waiting on 923b5a133fa8498737d15883785c154a 2023-07-14 09:15:37,471 INFO [RS:0;jenkins-hbase9:42505] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 09:15:37,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:15:37,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. after waiting 0 ms 2023-07-14 09:15:37,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:15:37,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 8420ef18efacc28679bf65a4aab0bd8c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 09:15:37,471 INFO [RS:0;jenkins-hbase9:42505] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 09:15:37,472 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 09:15:37,473 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 09:15:37,474 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 8420ef18efacc28679bf65a4aab0bd8c=hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c.} 2023-07-14 09:15:37,474 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1504): Waiting on 1588230740, 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:15:37,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 09:15:37,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 09:15:37,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 09:15:37,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 09:15:37,476 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 09:15:37,477 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 09:15:37,486 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:37,493 DEBUG [RS:1;jenkins-hbase9:41907] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs 2023-07-14 09:15:37,493 INFO [RS:1;jenkins-hbase9:41907] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C41907%2C1689325949930:(num 1689325953093) 2023-07-14 09:15:37,493 DEBUG [RS:1;jenkins-hbase9:41907] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,493 INFO [RS:1;jenkins-hbase9:41907] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:37,502 INFO [RS:1;jenkins-hbase9:41907] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 09:15:37,502 INFO [RS:1;jenkins-hbase9:41907] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 09:15:37,502 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:37,502 INFO [RS:1;jenkins-hbase9:41907] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 09:15:37,502 INFO [RS:1;jenkins-hbase9:41907] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 09:15:37,504 INFO [RS:1;jenkins-hbase9:41907] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41907 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41907,1689325949930 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:37,528 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:37,533 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41907,1689325949930] 2023-07-14 09:15:37,531 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:37,535 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41907,1689325949930; numProcessing=1 2023-07-14 09:15:37,539 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41907,1689325949930 already deleted, retry=false 2023-07-14 09:15:37,539 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,41907,1689325949930 expired; onlineServers=2 2023-07-14 09:15:37,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/.tmp/l/c9d70ab5eaa849e183e019c72d8ca800 2023-07-14 09:15:37,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9d70ab5eaa849e183e019c72d8ca800 2023-07-14 09:15:37,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/.tmp/l/c9d70ab5eaa849e183e019c72d8ca800 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/l/c9d70ab5eaa849e183e019c72d8ca800 2023-07-14 09:15:37,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9d70ab5eaa849e183e019c72d8ca800 2023-07-14 09:15:37,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/l/c9d70ab5eaa849e183e019c72d8ca800, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 09:15:37,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 923b5a133fa8498737d15883785c154a in 89ms, sequenceid=18, compaction requested=false 2023-07-14 09:15:37,563 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/.tmp/info/c64dee00bdc34b4f890ed9926447b1b8 2023-07-14 09:15:37,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/acl/923b5a133fa8498737d15883785c154a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 09:15:37,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c64dee00bdc34b4f890ed9926447b1b8 2023-07-14 09:15:37,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:15:37,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 923b5a133fa8498737d15883785c154a: 2023-07-14 09:15:37,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689325954882.923b5a133fa8498737d15883785c154a. 2023-07-14 09:15:37,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/.tmp/rep_barrier/602bdf658e004a6bb5ac14532978bcb5 2023-07-14 09:15:37,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 602bdf658e004a6bb5ac14532978bcb5 2023-07-14 09:15:37,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/.tmp/table/f666c27e762b481eb12a6981bb3778e4 2023-07-14 09:15:37,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f666c27e762b481eb12a6981bb3778e4 2023-07-14 09:15:37,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/.tmp/info/c64dee00bdc34b4f890ed9926447b1b8 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/info/c64dee00bdc34b4f890ed9926447b1b8 2023-07-14 09:15:37,609 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c64dee00bdc34b4f890ed9926447b1b8 2023-07-14 09:15:37,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/info/c64dee00bdc34b4f890ed9926447b1b8, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 09:15:37,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/.tmp/rep_barrier/602bdf658e004a6bb5ac14532978bcb5 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/rep_barrier/602bdf658e004a6bb5ac14532978bcb5 2023-07-14 09:15:37,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 602bdf658e004a6bb5ac14532978bcb5 2023-07-14 09:15:37,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/rep_barrier/602bdf658e004a6bb5ac14532978bcb5, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 09:15:37,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/.tmp/table/f666c27e762b481eb12a6981bb3778e4 as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/table/f666c27e762b481eb12a6981bb3778e4 2023-07-14 09:15:37,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f666c27e762b481eb12a6981bb3778e4 2023-07-14 09:15:37,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/table/f666c27e762b481eb12a6981bb3778e4, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 09:15:37,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 143ms, sequenceid=131, compaction requested=false 2023-07-14 09:15:37,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 09:15:37,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 09:15:37,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 09:15:37,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 09:15:37,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 09:15:37,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:37,634 INFO [RS:1;jenkins-hbase9:41907] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,41907,1689325949930; zookeeper connection closed. 2023-07-14 09:15:37,634 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:41907-0x101630d0c860002, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:37,634 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73da6cd3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73da6cd3 2023-07-14 09:15:37,671 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,38061,1689325950049; all regions closed. 2023-07-14 09:15:37,674 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1504): Waiting on 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:15:37,679 DEBUG [RS:2;jenkins-hbase9:38061] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs 2023-07-14 09:15:37,679 INFO [RS:2;jenkins-hbase9:38061] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C38061%2C1689325950049:(num 1689325953098) 2023-07-14 09:15:37,679 DEBUG [RS:2;jenkins-hbase9:38061] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:37,679 INFO [RS:2;jenkins-hbase9:38061] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:37,680 INFO [RS:2;jenkins-hbase9:38061] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 09:15:37,680 INFO [RS:2;jenkins-hbase9:38061] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 09:15:37,680 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:37,680 INFO [RS:2;jenkins-hbase9:38061] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 09:15:37,681 INFO [RS:2;jenkins-hbase9:38061] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 09:15:37,682 INFO [RS:2;jenkins-hbase9:38061] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38061 2023-07-14 09:15:37,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:37,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:15:37,685 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38061,1689325950049 2023-07-14 09:15:37,686 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,38061,1689325950049] 2023-07-14 09:15:37,686 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38061,1689325950049; numProcessing=2 2023-07-14 09:15:37,687 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,38061,1689325950049 already deleted, retry=false 2023-07-14 09:15:37,687 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,38061,1689325950049 expired; onlineServers=1 2023-07-14 09:15:37,787 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:37,787 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:38061-0x101630d0c860003, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:37,787 INFO [RS:2;jenkins-hbase9:38061] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38061,1689325950049; zookeeper connection closed. 2023-07-14 09:15:37,796 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4b5cdfe6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4b5cdfe6 2023-07-14 09:15:37,845 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 09:15:37,845 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 09:15:37,874 DEBUG [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1504): Waiting on 8420ef18efacc28679bf65a4aab0bd8c 2023-07-14 09:15:37,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/.tmp/info/e208d6a7d0c240758ad1b211ab67faec 2023-07-14 09:15:37,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/.tmp/info/e208d6a7d0c240758ad1b211ab67faec as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/info/e208d6a7d0c240758ad1b211ab67faec 2023-07-14 09:15:37,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/info/e208d6a7d0c240758ad1b211ab67faec, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 09:15:37,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8420ef18efacc28679bf65a4aab0bd8c in 488ms, sequenceid=6, compaction requested=false 2023-07-14 09:15:37,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/data/hbase/namespace/8420ef18efacc28679bf65a4aab0bd8c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 09:15:37,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:37,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:15:37,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8420ef18efacc28679bf65a4aab0bd8c: 2023-07-14 09:15:37,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689325953972.8420ef18efacc28679bf65a4aab0bd8c. 2023-07-14 09:15:38,074 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,42505,1689325949776; all regions closed. 2023-07-14 09:15:38,082 DEBUG [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs 2023-07-14 09:15:38,082 INFO [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42505%2C1689325949776.meta:.meta(num 1689325953504) 2023-07-14 09:15:38,091 DEBUG [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/oldWALs 2023-07-14 09:15:38,091 INFO [RS:0;jenkins-hbase9:42505] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C42505%2C1689325949776:(num 1689325953105) 2023-07-14 09:15:38,091 DEBUG [RS:0;jenkins-hbase9:42505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:38,091 INFO [RS:0;jenkins-hbase9:42505] regionserver.LeaseManager(133): Closed leases 2023-07-14 09:15:38,091 INFO [RS:0;jenkins-hbase9:42505] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 09:15:38,091 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:38,092 INFO [RS:0;jenkins-hbase9:42505] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42505 2023-07-14 09:15:38,094 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,42505,1689325949776 2023-07-14 09:15:38,094 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 09:15:38,097 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,42505,1689325949776] 2023-07-14 09:15:38,097 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,42505,1689325949776; numProcessing=3 2023-07-14 09:15:38,098 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,42505,1689325949776 already deleted, retry=false 2023-07-14 09:15:38,099 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,42505,1689325949776 expired; onlineServers=0 2023-07-14 09:15:38,099 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35455,1689325948029' ***** 2023-07-14 09:15:38,099 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 09:15:38,099 DEBUG [M:0;jenkins-hbase9:35455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39d909e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 09:15:38,099 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35455,1689325948029 2023-07-14 09:15:38,099 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35455,1689325948029; all regions closed. 2023-07-14 09:15:38,099 DEBUG [M:0;jenkins-hbase9:35455] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 09:15:38,099 DEBUG [M:0;jenkins-hbase9:35455] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 09:15:38,099 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 09:15:38,099 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689325952369] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689325952369,5,FailOnTimeoutGroup] 2023-07-14 09:15:38,099 DEBUG [M:0;jenkins-hbase9:35455] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 09:15:38,099 INFO [M:0;jenkins-hbase9:35455] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 09:15:38,100 INFO [M:0;jenkins-hbase9:35455] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 09:15:38,100 INFO [M:0;jenkins-hbase9:35455] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 09:15:38,100 DEBUG [M:0;jenkins-hbase9:35455] master.HMaster(1512): Stopping service threads 2023-07-14 09:15:38,100 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689325952370] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689325952370,5,FailOnTimeoutGroup] 2023-07-14 09:15:38,100 INFO [M:0;jenkins-hbase9:35455] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 09:15:38,100 ERROR [M:0;jenkins-hbase9:35455] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-14 09:15:38,100 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-24,5,PEWorkerGroup] Thread[HFileArchiver-25,5,PEWorkerGroup] 2023-07-14 09:15:38,100 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 09:15:38,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 09:15:38,101 INFO [M:0;jenkins-hbase9:35455] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 09:15:38,101 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 09:15:38,101 DEBUG [M:0;jenkins-hbase9:35455] zookeeper.ZKUtil(398): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 09:15:38,101 WARN [M:0;jenkins-hbase9:35455] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 09:15:38,101 INFO [M:0;jenkins-hbase9:35455] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 09:15:38,101 INFO [M:0;jenkins-hbase9:35455] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 09:15:38,102 DEBUG [M:0;jenkins-hbase9:35455] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 09:15:38,102 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:38,102 DEBUG [M:0;jenkins-hbase9:35455] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:38,102 DEBUG [M:0;jenkins-hbase9:35455] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 09:15:38,102 DEBUG [M:0;jenkins-hbase9:35455] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:38,102 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.33 KB heapSize=449.54 KB 2023-07-14 09:15:38,118 INFO [M:0;jenkins-hbase9:35455] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.33 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f0ad404008af42acaeacaa62a716996f 2023-07-14 09:15:38,123 INFO [M:0;jenkins-hbase9:35455] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0ad404008af42acaeacaa62a716996f 2023-07-14 09:15:38,124 DEBUG [M:0;jenkins-hbase9:35455] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f0ad404008af42acaeacaa62a716996f as hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f0ad404008af42acaeacaa62a716996f 2023-07-14 09:15:38,132 INFO [M:0;jenkins-hbase9:35455] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0ad404008af42acaeacaa62a716996f 2023-07-14 09:15:38,132 INFO [M:0;jenkins-hbase9:35455] regionserver.HStore(1080): Added hdfs://localhost:43917/user/jenkins/test-data/ed4fa349-1107-1101-d339-4db3118f92e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f0ad404008af42acaeacaa62a716996f, entries=119, sequenceid=899, filesize=28.4 K 2023-07-14 09:15:38,133 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegion(2948): Finished flush of dataSize ~373.33 KB/382291, heapSize ~449.52 KB/460312, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-14 09:15:38,139 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 09:15:38,139 DEBUG [M:0;jenkins-hbase9:35455] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 09:15:38,150 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 09:15:38,150 INFO [M:0;jenkins-hbase9:35455] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 09:15:38,151 INFO [M:0;jenkins-hbase9:35455] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35455 2023-07-14 09:15:38,153 DEBUG [M:0;jenkins-hbase9:35455] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,35455,1689325948029 already deleted, retry=false 2023-07-14 09:15:38,197 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:38,197 INFO [RS:0;jenkins-hbase9:42505] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,42505,1689325949776; zookeeper connection closed. 2023-07-14 09:15:38,197 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): regionserver:42505-0x101630d0c860001, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:38,198 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64d1f04c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64d1f04c 2023-07-14 09:15:38,198 INFO [Listener at jenkins-hbase9.apache.org/45963] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 09:15:38,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:38,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 09:15:38,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:38,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 09:15:38,239 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 09:15:38,298 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:38,298 INFO [M:0;jenkins-hbase9:35455] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35455,1689325948029; zookeeper connection closed. 2023-07-14 09:15:38,298 DEBUG [Listener at localhost/38149-EventThread] zookeeper.ZKWatcher(600): master:35455-0x101630d0c860000, quorum=127.0.0.1:63612, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 09:15:38,299 WARN [Listener at jenkins-hbase9.apache.org/45963] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 09:15:38,306 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:38,410 WARN [BP-1881175392-172.31.2.10-1689325943648 heartbeating to localhost/127.0.0.1:43917] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 09:15:38,410 WARN [BP-1881175392-172.31.2.10-1689325943648 heartbeating to localhost/127.0.0.1:43917] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1881175392-172.31.2.10-1689325943648 (Datanode Uuid 306b56a2-a7b2-450d-a24d-74b81cb98f8e) service to localhost/127.0.0.1:43917 2023-07-14 09:15:38,412 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data5/current/BP-1881175392-172.31.2.10-1689325943648] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:38,413 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data6/current/BP-1881175392-172.31.2.10-1689325943648] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:38,416 WARN [Listener at jenkins-hbase9.apache.org/45963] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 09:15:38,421 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:38,528 WARN [BP-1881175392-172.31.2.10-1689325943648 heartbeating to localhost/127.0.0.1:43917] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 09:15:38,528 WARN [BP-1881175392-172.31.2.10-1689325943648 heartbeating to localhost/127.0.0.1:43917] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1881175392-172.31.2.10-1689325943648 (Datanode Uuid 46f2c305-fe99-42ec-833e-254a73fca670) service to localhost/127.0.0.1:43917 2023-07-14 09:15:38,529 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data3/current/BP-1881175392-172.31.2.10-1689325943648] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:38,529 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data4/current/BP-1881175392-172.31.2.10-1689325943648] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:38,531 WARN [Listener at jenkins-hbase9.apache.org/45963] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 09:15:38,538 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:38,543 WARN [BP-1881175392-172.31.2.10-1689325943648 heartbeating to localhost/127.0.0.1:43917] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 09:15:38,543 WARN [BP-1881175392-172.31.2.10-1689325943648 heartbeating to localhost/127.0.0.1:43917] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1881175392-172.31.2.10-1689325943648 (Datanode Uuid dc9a4f0b-9fe1-4408-be0f-f8e75ae05747) service to localhost/127.0.0.1:43917 2023-07-14 09:15:38,544 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data1/current/BP-1881175392-172.31.2.10-1689325943648] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:38,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d0ca21f-b058-ead7-ddd2-8753dacff1da/cluster_ad506813-6b85-5065-2731-6a09bf075572/dfs/data/data2/current/BP-1881175392-172.31.2.10-1689325943648] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 09:15:38,578 INFO [Listener at jenkins-hbase9.apache.org/45963] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 09:15:38,712 INFO [Listener at jenkins-hbase9.apache.org/45963] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 09:15:38,831 INFO [Listener at jenkins-hbase9.apache.org/45963] hbase.HBaseTestingUtility(1293): Minicluster is down