2023-07-15 09:10:53,567 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 09:10:53,815 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb 2023-07-15 09:10:53,816 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-15 09:10:53,857 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 09:10:54,091 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 09:10:54,092 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1, deleteOnExit=true 2023-07-15 09:10:54,092 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 09:10:54,093 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/test.cache.data in system properties and HBase conf 2023-07-15 09:10:54,094 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 09:10:54,095 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop.log.dir in system properties and HBase conf 2023-07-15 09:10:54,096 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 09:10:54,096 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 09:10:54,096 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 09:10:54,424 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 09:10:54,430 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 09:10:54,431 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 09:10:54,431 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 09:10:54,431 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 09:10:54,432 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 09:10:54,432 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 09:10:54,433 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 09:10:54,433 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 09:10:54,434 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 09:10:54,434 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/nfs.dump.dir in system properties and HBase conf 2023-07-15 09:10:54,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir in system properties and HBase conf 2023-07-15 09:10:54,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 09:10:54,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 09:10:54,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 09:10:55,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 09:10:55,047 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 09:10:55,313 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 09:10:55,491 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 09:10:55,509 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:10:55,552 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:10:55,588 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_localhost_39015_hdfs____.d24pwo/webapp 2023-07-15 09:10:55,743 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39015 2023-07-15 09:10:55,785 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 09:10:55,785 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 09:10:56,222 WARN [Listener at localhost/38909] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 09:10:56,320 WARN [Listener at localhost/38909] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 09:10:56,345 WARN [Listener at localhost/38909] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:10:56,353 INFO [Listener at localhost/38909] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:10:56,362 INFO [Listener at localhost/38909] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_localhost_44091_datanode____.tpcle9/webapp 2023-07-15 09:10:56,507 INFO [Listener at localhost/38909] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44091 2023-07-15 09:10:57,159 WARN [Listener at localhost/38623] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 09:10:57,217 WARN [Listener at localhost/38623] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 09:10:57,223 WARN [Listener at localhost/38623] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:10:57,225 INFO [Listener at localhost/38623] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:10:57,233 INFO [Listener at localhost/38623] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_localhost_46717_datanode____nn9v7m/webapp 2023-07-15 09:10:57,366 INFO [Listener at localhost/38623] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46717 2023-07-15 09:10:57,386 WARN [Listener at localhost/36191] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 09:10:57,432 WARN [Listener at localhost/36191] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 09:10:57,440 WARN [Listener at localhost/36191] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:10:57,443 INFO [Listener at localhost/36191] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:10:57,448 INFO [Listener at localhost/36191] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_localhost_43291_datanode____slq24y/webapp 2023-07-15 09:10:57,590 INFO [Listener at localhost/36191] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43291 2023-07-15 09:10:57,621 WARN [Listener at localhost/37585] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 09:10:57,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1abd3fb79d1a08dd: Processing first storage report for DS-4de3c7f4-d477-4d14-bd91-4138e91661e1 from datanode c237a64d-d1bd-45f6-bcf7-9bb6de3b7db7 2023-07-15 09:10:57,923 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1abd3fb79d1a08dd: from storage DS-4de3c7f4-d477-4d14-bd91-4138e91661e1 node DatanodeRegistration(127.0.0.1:42153, datanodeUuid=c237a64d-d1bd-45f6-bcf7-9bb6de3b7db7, infoPort=39789, infoSecurePort=0, ipcPort=36191, storageInfo=lv=-57;cid=testClusterID;nsid=323790468;c=1689412255121), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 09:10:57,923 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x26c9fb49e1144ab5: Processing first storage report for DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a from datanode f8d5c4ed-f9e4-44f2-9582-15c78c24a8de 2023-07-15 09:10:57,923 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x26c9fb49e1144ab5: from storage DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a node DatanodeRegistration(127.0.0.1:33263, datanodeUuid=f8d5c4ed-f9e4-44f2-9582-15c78c24a8de, infoPort=35995, infoSecurePort=0, ipcPort=38623, storageInfo=lv=-57;cid=testClusterID;nsid=323790468;c=1689412255121), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 09:10:57,924 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8624a7996360f43: Processing first storage report for DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b from datanode 3a03f69e-ae93-49d8-845c-ee5bb438c11d 2023-07-15 09:10:57,924 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8624a7996360f43: from storage DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b node DatanodeRegistration(127.0.0.1:42221, datanodeUuid=3a03f69e-ae93-49d8-845c-ee5bb438c11d, infoPort=42943, infoSecurePort=0, ipcPort=37585, storageInfo=lv=-57;cid=testClusterID;nsid=323790468;c=1689412255121), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 09:10:57,924 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1abd3fb79d1a08dd: Processing first storage report for DS-2be2b900-6415-45d6-9f38-6cf9032a5b54 from datanode c237a64d-d1bd-45f6-bcf7-9bb6de3b7db7 2023-07-15 09:10:57,924 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1abd3fb79d1a08dd: from storage DS-2be2b900-6415-45d6-9f38-6cf9032a5b54 node DatanodeRegistration(127.0.0.1:42153, datanodeUuid=c237a64d-d1bd-45f6-bcf7-9bb6de3b7db7, infoPort=39789, infoSecurePort=0, ipcPort=36191, storageInfo=lv=-57;cid=testClusterID;nsid=323790468;c=1689412255121), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 09:10:57,924 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x26c9fb49e1144ab5: Processing first storage report for DS-cfb811ae-66f8-4ed3-8242-23ec845ee8e0 from datanode f8d5c4ed-f9e4-44f2-9582-15c78c24a8de 2023-07-15 09:10:57,924 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x26c9fb49e1144ab5: from storage DS-cfb811ae-66f8-4ed3-8242-23ec845ee8e0 node DatanodeRegistration(127.0.0.1:33263, datanodeUuid=f8d5c4ed-f9e4-44f2-9582-15c78c24a8de, infoPort=35995, infoSecurePort=0, ipcPort=38623, storageInfo=lv=-57;cid=testClusterID;nsid=323790468;c=1689412255121), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 09:10:57,925 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8624a7996360f43: Processing first storage report for DS-376988cc-f87c-4a74-8cfd-13829e575bce from datanode 3a03f69e-ae93-49d8-845c-ee5bb438c11d 2023-07-15 09:10:57,925 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8624a7996360f43: from storage DS-376988cc-f87c-4a74-8cfd-13829e575bce node DatanodeRegistration(127.0.0.1:42221, datanodeUuid=3a03f69e-ae93-49d8-845c-ee5bb438c11d, infoPort=42943, infoSecurePort=0, ipcPort=37585, storageInfo=lv=-57;cid=testClusterID;nsid=323790468;c=1689412255121), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 09:10:58,156 DEBUG [Listener at localhost/37585] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb 2023-07-15 09:10:58,251 INFO [Listener at localhost/37585] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/zookeeper_0, clientPort=64993, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 09:10:58,275 INFO [Listener at localhost/37585] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64993 2023-07-15 09:10:58,293 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:10:58,295 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:10:59,025 INFO [Listener at localhost/37585] util.FSUtils(471): Created version file at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd with version=8 2023-07-15 09:10:59,026 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/hbase-staging 2023-07-15 09:10:59,385 INFO [Listener at localhost/37585] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 09:10:59,932 INFO [Listener at localhost/37585] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 09:10:59,974 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:10:59,975 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 09:10:59,976 INFO [Listener at localhost/37585] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 09:10:59,976 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:10:59,976 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 09:11:00,144 INFO [Listener at localhost/37585] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 09:11:00,232 DEBUG [Listener at localhost/37585] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 09:11:00,342 INFO [Listener at localhost/37585] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41729 2023-07-15 09:11:00,356 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,358 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,384 INFO [Listener at localhost/37585] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41729 connecting to ZooKeeper ensemble=127.0.0.1:64993 2023-07-15 09:11:00,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:417290x0, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 09:11:00,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41729-0x101683fccb70000 connected 2023-07-15 09:11:00,477 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 09:11:00,478 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:11:00,497 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 09:11:00,510 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41729 2023-07-15 09:11:00,510 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41729 2023-07-15 09:11:00,511 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41729 2023-07-15 09:11:00,512 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41729 2023-07-15 09:11:00,512 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41729 2023-07-15 09:11:00,525 INFO [Listener at localhost/37585] master.HMaster(444): hbase.rootdir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, hbase.cluster.distributed=false 2023-07-15 09:11:00,599 INFO [Listener at localhost/37585] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 09:11:00,599 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,600 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,600 INFO [Listener at localhost/37585] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 09:11:00,600 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,600 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 09:11:00,607 INFO [Listener at localhost/37585] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 09:11:00,611 INFO [Listener at localhost/37585] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44901 2023-07-15 09:11:00,615 INFO [Listener at localhost/37585] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 09:11:00,624 DEBUG [Listener at localhost/37585] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 09:11:00,625 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,627 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,629 INFO [Listener at localhost/37585] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44901 connecting to ZooKeeper ensemble=127.0.0.1:64993 2023-07-15 09:11:00,634 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:449010x0, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 09:11:00,634 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:449010x0, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 09:11:00,641 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:449010x0, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:11:00,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44901-0x101683fccb70001 connected 2023-07-15 09:11:00,642 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 09:11:00,646 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44901 2023-07-15 09:11:00,646 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44901 2023-07-15 09:11:00,647 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44901 2023-07-15 09:11:00,647 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44901 2023-07-15 09:11:00,648 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44901 2023-07-15 09:11:00,661 INFO [Listener at localhost/37585] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 09:11:00,662 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,662 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,662 INFO [Listener at localhost/37585] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 09:11:00,663 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,663 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 09:11:00,663 INFO [Listener at localhost/37585] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 09:11:00,665 INFO [Listener at localhost/37585] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40347 2023-07-15 09:11:00,665 INFO [Listener at localhost/37585] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 09:11:00,667 DEBUG [Listener at localhost/37585] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 09:11:00,668 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,671 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,673 INFO [Listener at localhost/37585] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40347 connecting to ZooKeeper ensemble=127.0.0.1:64993 2023-07-15 09:11:00,681 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:403470x0, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 09:11:00,686 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:403470x0, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 09:11:00,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40347-0x101683fccb70002 connected 2023-07-15 09:11:00,688 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:11:00,692 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 09:11:00,700 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40347 2023-07-15 09:11:00,706 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40347 2023-07-15 09:11:00,707 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40347 2023-07-15 09:11:00,710 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40347 2023-07-15 09:11:00,711 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40347 2023-07-15 09:11:00,725 INFO [Listener at localhost/37585] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 09:11:00,725 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,725 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,725 INFO [Listener at localhost/37585] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 09:11:00,725 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 09:11:00,726 INFO [Listener at localhost/37585] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 09:11:00,726 INFO [Listener at localhost/37585] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 09:11:00,727 INFO [Listener at localhost/37585] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36901 2023-07-15 09:11:00,728 INFO [Listener at localhost/37585] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 09:11:00,729 DEBUG [Listener at localhost/37585] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 09:11:00,730 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,732 INFO [Listener at localhost/37585] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,733 INFO [Listener at localhost/37585] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36901 connecting to ZooKeeper ensemble=127.0.0.1:64993 2023-07-15 09:11:00,739 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:369010x0, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 09:11:00,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36901-0x101683fccb70003 connected 2023-07-15 09:11:00,740 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 09:11:00,741 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:11:00,742 DEBUG [Listener at localhost/37585] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 09:11:00,742 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36901 2023-07-15 09:11:00,743 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36901 2023-07-15 09:11:00,744 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36901 2023-07-15 09:11:00,749 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36901 2023-07-15 09:11:00,750 DEBUG [Listener at localhost/37585] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36901 2023-07-15 09:11:00,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:00,761 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 09:11:00,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:00,785 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 09:11:00,785 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 09:11:00,785 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 09:11:00,785 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 09:11:00,786 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:00,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 09:11:00,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 09:11:00,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41729,1689412259202 from backup master directory 2023-07-15 09:11:00,794 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:00,794 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 09:11:00,795 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 09:11:00,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:00,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 09:11:00,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 09:11:00,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/hbase.id with ID: 94bc1943-34c1-453e-bbf4-8b07fad189d6 2023-07-15 09:11:00,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 09:11:00,990 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:01,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c43d08d to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:01,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a4bec0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:01,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:01,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 09:11:01,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 09:11:01,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 09:11:01,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 09:11:01,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 09:11:01,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 09:11:01,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store-tmp 2023-07-15 09:11:01,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:01,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 09:11:01,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:11:01,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:11:01,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 09:11:01,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:11:01,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:11:01,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 09:11:01,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/WALs/jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:01,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41729%2C1689412259202, suffix=, logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/WALs/jenkins-hbase4.apache.org,41729,1689412259202, archiveDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/oldWALs, maxLogs=10 2023-07-15 09:11:01,400 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK] 2023-07-15 09:11:01,400 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK] 2023-07-15 09:11:01,400 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK] 2023-07-15 09:11:01,409 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 09:11:01,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/WALs/jenkins-hbase4.apache.org,41729,1689412259202/jenkins-hbase4.apache.org%2C41729%2C1689412259202.1689412261322 2023-07-15 09:11:01,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK], DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK], DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK]] 2023-07-15 09:11:01,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 09:11:01,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:01,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 09:11:01,491 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 09:11:01,566 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 09:11:01,574 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 09:11:01,612 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 09:11:01,628 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:01,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 09:11:01,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 09:11:01,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 09:11:01,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:01,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68422740, jitterRate=0.019578278064727783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:01,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 09:11:01,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 09:11:01,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 09:11:01,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 09:11:01,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 09:11:01,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 09:11:01,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-15 09:11:01,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 09:11:01,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 09:11:01,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 09:11:01,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 09:11:01,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 09:11:01,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 09:11:01,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 09:11:01,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 09:11:01,848 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:01,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 09:11:01,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 09:11:01,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 09:11:01,874 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 09:11:01,874 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 09:11:01,874 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 09:11:01,875 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 09:11:01,875 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:01,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41729,1689412259202, sessionid=0x101683fccb70000, setting cluster-up flag (Was=false) 2023-07-15 09:11:01,899 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:01,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 09:11:01,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:01,915 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:01,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 09:11:01,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:01,928 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp 2023-07-15 09:11:01,956 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(951): ClusterId : 94bc1943-34c1-453e-bbf4-8b07fad189d6 2023-07-15 09:11:01,958 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(951): ClusterId : 94bc1943-34c1-453e-bbf4-8b07fad189d6 2023-07-15 09:11:01,965 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(951): ClusterId : 94bc1943-34c1-453e-bbf4-8b07fad189d6 2023-07-15 09:11:01,971 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 09:11:01,975 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 09:11:01,976 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 09:11:01,985 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 09:11:01,985 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 09:11:01,986 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 09:11:01,986 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 09:11:01,994 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 09:11:01,994 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 09:11:01,995 DEBUG [RS:2;jenkins-hbase4:36901] zookeeper.ReadOnlyZKClient(139): Connect 0x47d936fa to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:01,997 DEBUG [RS:1;jenkins-hbase4:40347] zookeeper.ReadOnlyZKClient(139): Connect 0x48038a99 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:01,997 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 09:11:01,997 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 09:11:02,002 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 09:11:02,009 DEBUG [RS:0;jenkins-hbase4:44901] zookeeper.ReadOnlyZKClient(139): Connect 0x2150e14d to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:02,063 DEBUG [RS:1;jenkins-hbase4:40347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60c43de3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:02,064 DEBUG [RS:1;jenkins-hbase4:40347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@706f69b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 09:11:02,087 DEBUG [RS:2;jenkins-hbase4:36901] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6757931f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:02,088 DEBUG [RS:2;jenkins-hbase4:36901] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3faf1a6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 09:11:02,088 DEBUG [RS:0;jenkins-hbase4:44901] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64526b03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:02,089 DEBUG [RS:0;jenkins-hbase4:44901] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b44fcd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 09:11:02,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 09:11:02,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:02,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 09:11:02,112 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40347 2023-07-15 09:11:02,119 INFO [RS:1;jenkins-hbase4:40347] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 09:11:02,119 INFO [RS:1;jenkins-hbase4:40347] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 09:11:02,119 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44901 2023-07-15 09:11:02,120 INFO [RS:0;jenkins-hbase4:44901] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 09:11:02,120 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 09:11:02,120 INFO [RS:0;jenkins-hbase4:44901] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 09:11:02,121 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 09:11:02,122 INFO [RS:1;jenkins-hbase4:40347] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:02,123 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 09:11:02,125 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36901 2023-07-15 09:11:02,125 INFO [RS:2;jenkins-hbase4:36901] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 09:11:02,125 INFO [RS:2;jenkins-hbase4:36901] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 09:11:02,126 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 09:11:02,126 INFO [RS:2;jenkins-hbase4:36901] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:02,126 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 09:11:02,126 INFO [RS:0;jenkins-hbase4:44901] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:02,126 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 09:11:02,127 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41729,1689412259202 with isa=jenkins-hbase4.apache.org/172.31.14.131:40347, startcode=1689412260661 2023-07-15 09:11:02,127 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41729,1689412259202 with isa=jenkins-hbase4.apache.org/172.31.14.131:36901, startcode=1689412260724 2023-07-15 09:11:02,128 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41729,1689412259202 with isa=jenkins-hbase4.apache.org/172.31.14.131:44901, startcode=1689412260598 2023-07-15 09:11:02,167 DEBUG [RS:0;jenkins-hbase4:44901] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 09:11:02,170 DEBUG [RS:1;jenkins-hbase4:40347] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 09:11:02,170 DEBUG [RS:2;jenkins-hbase4:36901] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 09:11:02,249 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58347, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 09:11:02,249 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55811, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 09:11:02,249 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50161, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 09:11:02,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 09:11:02,264 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41729] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 09:11:02,275 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41729] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 09:11:02,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 09:11:02,276 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41729] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 09:11:02,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 09:11:02,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 09:11:02,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 09:11:02,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 09:11:02,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 09:11:02,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689412292295 2023-07-15 09:11:02,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 09:11:02,304 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 09:11:02,305 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 09:11:02,310 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:02,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 09:11:02,314 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 09:11:02,315 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 09:11:02,316 WARN [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 09:11:02,316 WARN [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 09:11:02,314 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 09:11:02,323 WARN [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 09:11:02,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 09:11:02,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 09:11:02,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 09:11:02,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 09:11:02,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 09:11:02,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 09:11:02,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 09:11:02,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 09:11:02,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 09:11:02,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689412262345,5,FailOnTimeoutGroup] 2023-07-15 09:11:02,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689412262351,5,FailOnTimeoutGroup] 2023-07-15 09:11:02,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 09:11:02,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,416 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:02,417 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41729,1689412259202 with isa=jenkins-hbase4.apache.org/172.31.14.131:44901, startcode=1689412260598 2023-07-15 09:11:02,417 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41729,1689412259202 with isa=jenkins-hbase4.apache.org/172.31.14.131:40347, startcode=1689412260661 2023-07-15 09:11:02,417 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:02,418 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:02,424 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41729,1689412259202 with isa=jenkins-hbase4.apache.org/172.31.14.131:36901, startcode=1689412260724 2023-07-15 09:11:02,426 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,435 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,436 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41729] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,438 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:02,438 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38909 2023-07-15 09:11:02,438 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 09:11:02,440 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:02,441 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:02,441 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38909 2023-07-15 09:11:02,441 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38909 2023-07-15 09:11:02,441 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 09:11:02,441 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 09:11:02,470 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:11:02,471 DEBUG [RS:0;jenkins-hbase4:44901] zookeeper.ZKUtil(162): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,471 DEBUG [RS:2;jenkins-hbase4:36901] zookeeper.ZKUtil(162): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,471 WARN [RS:0;jenkins-hbase4:44901] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 09:11:02,471 WARN [RS:2;jenkins-hbase4:36901] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 09:11:02,473 INFO [RS:0;jenkins-hbase4:44901] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 09:11:02,474 DEBUG [RS:1;jenkins-hbase4:40347] zookeeper.ZKUtil(162): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,474 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,474 WARN [RS:1;jenkins-hbase4:40347] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 09:11:02,474 INFO [RS:2;jenkins-hbase4:36901] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 09:11:02,474 INFO [RS:1;jenkins-hbase4:40347] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 09:11:02,475 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,476 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36901,1689412260724] 2023-07-15 09:11:02,505 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44901,1689412260598] 2023-07-15 09:11:02,505 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40347,1689412260661] 2023-07-15 09:11:02,540 DEBUG [RS:1;jenkins-hbase4:40347] zookeeper.ZKUtil(162): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,540 DEBUG [RS:0;jenkins-hbase4:44901] zookeeper.ZKUtil(162): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,540 DEBUG [RS:1;jenkins-hbase4:40347] zookeeper.ZKUtil(162): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,540 DEBUG [RS:2;jenkins-hbase4:36901] zookeeper.ZKUtil(162): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,541 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:02,541 DEBUG [RS:1;jenkins-hbase4:40347] zookeeper.ZKUtil(162): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,541 DEBUG [RS:0;jenkins-hbase4:44901] zookeeper.ZKUtil(162): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,542 DEBUG [RS:2;jenkins-hbase4:36901] zookeeper.ZKUtil(162): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,543 DEBUG [RS:2;jenkins-hbase4:36901] zookeeper.ZKUtil(162): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,543 DEBUG [RS:0;jenkins-hbase4:44901] zookeeper.ZKUtil(162): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,557 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 09:11:02,557 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 09:11:02,557 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 09:11:02,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 09:11:02,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/info 2023-07-15 09:11:02,570 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 09:11:02,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:02,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 09:11:02,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/rep_barrier 2023-07-15 09:11:02,574 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 09:11:02,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:02,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 09:11:02,580 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/table 2023-07-15 09:11:02,581 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 09:11:02,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:02,584 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740 2023-07-15 09:11:02,585 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740 2023-07-15 09:11:02,586 INFO [RS:0;jenkins-hbase4:44901] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 09:11:02,587 INFO [RS:1;jenkins-hbase4:40347] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 09:11:02,595 INFO [RS:2;jenkins-hbase4:36901] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 09:11:02,598 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 09:11:02,601 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 09:11:02,615 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:02,621 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60797594, jitterRate=-0.0940452516078949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 09:11:02,621 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 09:11:02,621 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 09:11:02,621 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 09:11:02,621 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 09:11:02,621 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 09:11:02,621 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 09:11:02,625 INFO [RS:0;jenkins-hbase4:44901] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 09:11:02,625 INFO [RS:2;jenkins-hbase4:36901] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 09:11:02,631 INFO [RS:1;jenkins-hbase4:40347] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 09:11:02,631 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 09:11:02,634 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 09:11:02,637 INFO [RS:0;jenkins-hbase4:44901] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 09:11:02,637 INFO [RS:2;jenkins-hbase4:36901] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 09:11:02,638 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,637 INFO [RS:1;jenkins-hbase4:40347] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 09:11:02,638 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,638 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,640 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 09:11:02,641 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 09:11:02,641 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 09:11:02,644 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 09:11:02,644 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 09:11:02,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 09:11:02,656 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,656 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,656 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,656 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,657 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 09:11:02,658 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 09:11:02,659 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:0;jenkins-hbase4:44901] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,658 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,660 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,660 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,661 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 09:11:02,661 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,661 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,662 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,662 DEBUG [RS:1;jenkins-hbase4:40347] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,659 DEBUG [RS:2;jenkins-hbase4:36901] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 09:11:02,666 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,666 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,667 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,671 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,672 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,672 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,686 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,686 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,687 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,691 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 09:11:02,702 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 09:11:02,712 INFO [RS:2;jenkins-hbase4:36901] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 09:11:02,717 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36901,1689412260724-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,714 INFO [RS:1;jenkins-hbase4:40347] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 09:11:02,718 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40347,1689412260661-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,718 INFO [RS:0;jenkins-hbase4:44901] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 09:11:02,719 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44901,1689412260598-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:02,742 INFO [RS:1;jenkins-hbase4:40347] regionserver.Replication(203): jenkins-hbase4.apache.org,40347,1689412260661 started 2023-07-15 09:11:02,743 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40347,1689412260661, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40347, sessionid=0x101683fccb70002 2023-07-15 09:11:02,743 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 09:11:02,743 DEBUG [RS:1;jenkins-hbase4:40347] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,743 DEBUG [RS:1;jenkins-hbase4:40347] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40347,1689412260661' 2023-07-15 09:11:02,743 DEBUG [RS:1;jenkins-hbase4:40347] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 09:11:02,744 INFO [RS:0;jenkins-hbase4:44901] regionserver.Replication(203): jenkins-hbase4.apache.org,44901,1689412260598 started 2023-07-15 09:11:02,744 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44901,1689412260598, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44901, sessionid=0x101683fccb70001 2023-07-15 09:11:02,744 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 09:11:02,744 DEBUG [RS:1;jenkins-hbase4:40347] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 09:11:02,744 DEBUG [RS:0;jenkins-hbase4:44901] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,745 DEBUG [RS:0;jenkins-hbase4:44901] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44901,1689412260598' 2023-07-15 09:11:02,747 DEBUG [RS:0;jenkins-hbase4:44901] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 09:11:02,748 DEBUG [RS:0;jenkins-hbase4:44901] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 09:11:02,748 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 09:11:02,748 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 09:11:02,748 DEBUG [RS:1;jenkins-hbase4:40347] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:02,748 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 09:11:02,748 DEBUG [RS:1;jenkins-hbase4:40347] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40347,1689412260661' 2023-07-15 09:11:02,749 DEBUG [RS:1;jenkins-hbase4:40347] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:02,749 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 09:11:02,749 DEBUG [RS:0;jenkins-hbase4:44901] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:02,750 DEBUG [RS:0;jenkins-hbase4:44901] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44901,1689412260598' 2023-07-15 09:11:02,750 DEBUG [RS:0;jenkins-hbase4:44901] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:02,750 DEBUG [RS:1;jenkins-hbase4:40347] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:02,750 DEBUG [RS:0;jenkins-hbase4:44901] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:02,751 DEBUG [RS:1;jenkins-hbase4:40347] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 09:11:02,751 INFO [RS:1;jenkins-hbase4:40347] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 09:11:02,751 INFO [RS:1;jenkins-hbase4:40347] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 09:11:02,751 DEBUG [RS:0;jenkins-hbase4:44901] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 09:11:02,751 INFO [RS:0;jenkins-hbase4:44901] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 09:11:02,752 INFO [RS:0;jenkins-hbase4:44901] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 09:11:02,759 INFO [RS:2;jenkins-hbase4:36901] regionserver.Replication(203): jenkins-hbase4.apache.org,36901,1689412260724 started 2023-07-15 09:11:02,759 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36901,1689412260724, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36901, sessionid=0x101683fccb70003 2023-07-15 09:11:02,759 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 09:11:02,759 DEBUG [RS:2;jenkins-hbase4:36901] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,759 DEBUG [RS:2;jenkins-hbase4:36901] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36901,1689412260724' 2023-07-15 09:11:02,759 DEBUG [RS:2;jenkins-hbase4:36901] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 09:11:02,760 DEBUG [RS:2;jenkins-hbase4:36901] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 09:11:02,761 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 09:11:02,761 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 09:11:02,762 DEBUG [RS:2;jenkins-hbase4:36901] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:02,762 DEBUG [RS:2;jenkins-hbase4:36901] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36901,1689412260724' 2023-07-15 09:11:02,762 DEBUG [RS:2;jenkins-hbase4:36901] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:02,763 DEBUG [RS:2;jenkins-hbase4:36901] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:02,763 DEBUG [RS:2;jenkins-hbase4:36901] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 09:11:02,763 INFO [RS:2;jenkins-hbase4:36901] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 09:11:02,763 INFO [RS:2;jenkins-hbase4:36901] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 09:11:02,857 DEBUG [jenkins-hbase4:41729] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 09:11:02,866 INFO [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44901%2C1689412260598, suffix=, logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,44901,1689412260598, archiveDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs, maxLogs=32 2023-07-15 09:11:02,869 DEBUG [jenkins-hbase4:41729] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:11:02,867 INFO [RS:2;jenkins-hbase4:36901] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36901%2C1689412260724, suffix=, logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,36901,1689412260724, archiveDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs, maxLogs=32 2023-07-15 09:11:02,875 INFO [RS:1;jenkins-hbase4:40347] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40347%2C1689412260661, suffix=, logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,40347,1689412260661, archiveDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs, maxLogs=32 2023-07-15 09:11:02,877 DEBUG [jenkins-hbase4:41729] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:11:02,878 DEBUG [jenkins-hbase4:41729] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:11:02,878 DEBUG [jenkins-hbase4:41729] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:11:02,878 DEBUG [jenkins-hbase4:41729] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:11:02,887 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44901,1689412260598, state=OPENING 2023-07-15 09:11:02,910 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 09:11:02,921 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:02,924 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 09:11:02,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:11:02,932 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK] 2023-07-15 09:11:02,967 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK] 2023-07-15 09:11:02,980 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK] 2023-07-15 09:11:02,981 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK] 2023-07-15 09:11:02,982 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK] 2023-07-15 09:11:02,982 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK] 2023-07-15 09:11:03,004 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK] 2023-07-15 09:11:03,004 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK] 2023-07-15 09:11:03,004 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK] 2023-07-15 09:11:03,023 INFO [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,44901,1689412260598/jenkins-hbase4.apache.org%2C44901%2C1689412260598.1689412262872 2023-07-15 09:11:03,023 INFO [RS:1;jenkins-hbase4:40347] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,40347,1689412260661/jenkins-hbase4.apache.org%2C40347%2C1689412260661.1689412262876 2023-07-15 09:11:03,024 DEBUG [RS:1;jenkins-hbase4:40347] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK], DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK], DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK]] 2023-07-15 09:11:03,025 DEBUG [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK], DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK], DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK]] 2023-07-15 09:11:03,030 INFO [RS:2;jenkins-hbase4:36901] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,36901,1689412260724/jenkins-hbase4.apache.org%2C36901%2C1689412260724.1689412262873 2023-07-15 09:11:03,034 DEBUG [RS:2;jenkins-hbase4:36901] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK], DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK], DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK]] 2023-07-15 09:11:03,215 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:03,218 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 09:11:03,223 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 09:11:03,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 09:11:03,238 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 09:11:03,242 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44901%2C1689412260598.meta, suffix=.meta, logDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,44901,1689412260598, archiveDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs, maxLogs=32 2023-07-15 09:11:03,274 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK] 2023-07-15 09:11:03,279 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK] 2023-07-15 09:11:03,281 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK] 2023-07-15 09:11:03,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/WALs/jenkins-hbase4.apache.org,44901,1689412260598/jenkins-hbase4.apache.org%2C44901%2C1689412260598.meta.1689412263244.meta 2023-07-15 09:11:03,298 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33263,DS-6172b5ab-a9d6-4045-a1fc-435d9b8b4c9a,DISK], DatanodeInfoWithStorage[127.0.0.1:42221,DS-c23f6c1e-8973-4e59-b8a7-74b155186d5b,DISK], DatanodeInfoWithStorage[127.0.0.1:42153,DS-4de3c7f4-d477-4d14-bd91-4138e91661e1,DISK]] 2023-07-15 09:11:03,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 09:11:03,300 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 09:11:03,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:03,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 09:11:03,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 09:11:03,306 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 09:11:03,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 09:11:03,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:03,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 09:11:03,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 09:11:03,327 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 09:11:03,330 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/info 2023-07-15 09:11:03,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/info 2023-07-15 09:11:03,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 09:11:03,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:03,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 09:11:03,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/rep_barrier 2023-07-15 09:11:03,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/rep_barrier 2023-07-15 09:11:03,336 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 09:11:03,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:03,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 09:11:03,339 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/table 2023-07-15 09:11:03,340 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/table 2023-07-15 09:11:03,340 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 09:11:03,341 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:03,344 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740 2023-07-15 09:11:03,347 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740 2023-07-15 09:11:03,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 09:11:03,355 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 09:11:03,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64758200, jitterRate=-0.03502762317657471}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 09:11:03,360 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 09:11:03,379 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689412263203 2023-07-15 09:11:03,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 09:11:03,403 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 09:11:03,407 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44901,1689412260598, state=OPEN 2023-07-15 09:11:03,411 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 09:11:03,411 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 09:11:03,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 09:11:03,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44901,1689412260598 in 482 msec 2023-07-15 09:11:03,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 09:11:03,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 768 msec 2023-07-15 09:11:03,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3300 sec 2023-07-15 09:11:03,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689412263440, completionTime=-1 2023-07-15 09:11:03,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 09:11:03,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 09:11:03,535 DEBUG [hconnection-0x6f656688-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:03,549 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:03,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 09:11:03,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689412323580 2023-07-15 09:11:03,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689412383580 2023-07-15 09:11:03,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 139 msec 2023-07-15 09:11:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41729,1689412259202-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:03,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41729,1689412259202-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:03,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41729,1689412259202-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:03,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41729, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:03,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 09:11:03,634 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 09:11:03,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 09:11:03,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:03,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 09:11:03,672 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:11:03,676 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:11:03,710 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:03,714 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57 empty. 2023-07-15 09:11:03,715 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:03,715 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 09:11:03,782 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:03,785 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2cfd2b74610013f4dd58ef21bd029e57, NAME => 'hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:03,830 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:03,830 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2cfd2b74610013f4dd58ef21bd029e57, disabling compactions & flushes 2023-07-15 09:11:03,830 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:03,830 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:03,830 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. after waiting 0 ms 2023-07-15 09:11:03,831 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:03,831 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:03,831 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2cfd2b74610013f4dd58ef21bd029e57: 2023-07-15 09:11:03,837 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:11:03,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689412263841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412263841"}]},"ts":"1689412263841"} 2023-07-15 09:11:03,889 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 09:11:03,891 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:11:03,897 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412263891"}]},"ts":"1689412263891"} 2023-07-15 09:11:03,903 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 09:11:03,908 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:11:03,909 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:11:03,909 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:11:03,910 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:11:03,910 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:11:03,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2cfd2b74610013f4dd58ef21bd029e57, ASSIGN}] 2023-07-15 09:11:03,915 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2cfd2b74610013f4dd58ef21bd029e57, ASSIGN 2023-07-15 09:11:03,917 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2cfd2b74610013f4dd58ef21bd029e57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40347,1689412260661; forceNewPlan=false, retain=false 2023-07-15 09:11:04,070 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 09:11:04,071 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2cfd2b74610013f4dd58ef21bd029e57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:04,071 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689412264071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412264071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412264071"}]},"ts":"1689412264071"} 2023-07-15 09:11:04,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2cfd2b74610013f4dd58ef21bd029e57, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:11:04,233 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:04,233 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 09:11:04,236 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 09:11:04,244 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:04,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2cfd2b74610013f4dd58ef21bd029e57, NAME => 'hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.', STARTKEY => '', ENDKEY => ''} 2023-07-15 09:11:04,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. service=AccessControlService 2023-07-15 09:11:04,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:04,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:04,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,246 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,248 INFO [StoreOpener-2cfd2b74610013f4dd58ef21bd029e57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,251 DEBUG [StoreOpener-2cfd2b74610013f4dd58ef21bd029e57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/info 2023-07-15 09:11:04,251 DEBUG [StoreOpener-2cfd2b74610013f4dd58ef21bd029e57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/info 2023-07-15 09:11:04,251 INFO [StoreOpener-2cfd2b74610013f4dd58ef21bd029e57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2cfd2b74610013f4dd58ef21bd029e57 columnFamilyName info 2023-07-15 09:11:04,252 INFO [StoreOpener-2cfd2b74610013f4dd58ef21bd029e57-1] regionserver.HStore(310): Store=2cfd2b74610013f4dd58ef21bd029e57/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:04,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:11:04,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:04,283 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2cfd2b74610013f4dd58ef21bd029e57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70061676, jitterRate=0.044000327587127686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:04,284 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2cfd2b74610013f4dd58ef21bd029e57: 2023-07-15 09:11:04,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57., pid=6, masterSystemTime=1689412264232 2023-07-15 09:11:04,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:04,299 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:11:04,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2cfd2b74610013f4dd58ef21bd029e57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:04,302 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689412264300"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412264300"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412264300"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412264300"}]},"ts":"1689412264300"} 2023-07-15 09:11:04,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 09:11:04,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2cfd2b74610013f4dd58ef21bd029e57, server=jenkins-hbase4.apache.org,40347,1689412260661 in 227 msec 2023-07-15 09:11:04,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 09:11:04,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2cfd2b74610013f4dd58ef21bd029e57, ASSIGN in 398 msec 2023-07-15 09:11:04,318 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:11:04,318 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412264318"}]},"ts":"1689412264318"} 2023-07-15 09:11:04,321 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 09:11:04,325 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:11:04,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 666 msec 2023-07-15 09:11:04,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 09:11:04,375 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 09:11:04,376 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:04,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:04,438 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:04,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 09:11:04,472 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 09:11:04,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-07-15 09:11:04,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 09:11:04,519 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 09:11:04,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 37 msec 2023-07-15 09:11:04,541 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 09:11:04,544 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 09:11:04,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.750sec 2023-07-15 09:11:04,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 09:11:04,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 09:11:04,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 09:11:04,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41729,1689412259202-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 09:11:04,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41729,1689412259202-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 09:11:04,569 DEBUG [Listener at localhost/37585] zookeeper.ReadOnlyZKClient(139): Connect 0x34d8312b to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:04,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:04,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 09:11:04,586 DEBUG [Listener at localhost/37585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c4df18f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:04,591 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:11:04,595 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:11:04,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 09:11:04,604 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:04,608 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f empty. 2023-07-15 09:11:04,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 09:11:04,610 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:04,611 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 09:11:04,613 DEBUG [hconnection-0xe93615c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:04,632 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:04,636 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:11:04,636 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 09:11:04,636 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/test.cache.data in system properties and HBase conf 2023-07-15 09:11:04,637 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 09:11:04,647 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop.log.dir in system properties and HBase conf 2023-07-15 09:11:04,647 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 09:11:04,647 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 09:11:04,650 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 09:11:04,650 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 09:11:04,650 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 09:11:04,650 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 09:11:04,651 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 09:11:04,651 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 09:11:04,651 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 09:11:04,651 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 09:11:04,651 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 09:11:04,651 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 09:11:04,652 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/nfs.dump.dir in system properties and HBase conf 2023-07-15 09:11:04,653 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir in system properties and HBase conf 2023-07-15 09:11:04,653 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 09:11:04,653 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 09:11:04,654 INFO [Listener at localhost/37585] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 09:11:04,662 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:04,667 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 732ddc5a869d77de3f910ca12c40797f, NAME => 'hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:04,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 09:11:04,734 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:04,741 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 732ddc5a869d77de3f910ca12c40797f, disabling compactions & flushes 2023-07-15 09:11:04,741 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:04,741 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:04,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. after waiting 0 ms 2023-07-15 09:11:04,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:04,742 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:04,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 732ddc5a869d77de3f910ca12c40797f: 2023-07-15 09:11:04,752 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:11:04,754 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689412264754"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412264754"}]},"ts":"1689412264754"} 2023-07-15 09:11:04,760 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 09:11:04,762 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:11:04,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412264762"}]},"ts":"1689412264762"} 2023-07-15 09:11:04,764 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 09:11:04,771 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:11:04,772 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:11:04,772 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:11:04,772 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:11:04,772 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:11:04,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=732ddc5a869d77de3f910ca12c40797f, ASSIGN}] 2023-07-15 09:11:04,778 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=732ddc5a869d77de3f910ca12c40797f, ASSIGN 2023-07-15 09:11:04,780 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=732ddc5a869d77de3f910ca12c40797f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36901,1689412260724; forceNewPlan=false, retain=false 2023-07-15 09:11:04,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 09:11:04,931 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 09:11:04,932 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=732ddc5a869d77de3f910ca12c40797f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:04,932 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689412264932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412264932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412264932"}]},"ts":"1689412264932"} 2023-07-15 09:11:04,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 732ddc5a869d77de3f910ca12c40797f, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:11:05,094 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:05,094 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 09:11:05,096 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 09:11:05,103 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:05,103 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 732ddc5a869d77de3f910ca12c40797f, NAME => 'hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.', STARTKEY => '', ENDKEY => ''} 2023-07-15 09:11:05,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. service=AccessControlService 2023-07-15 09:11:05,104 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:05,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:05,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,106 INFO [StoreOpener-732ddc5a869d77de3f910ca12c40797f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,109 DEBUG [StoreOpener-732ddc5a869d77de3f910ca12c40797f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/l 2023-07-15 09:11:05,109 DEBUG [StoreOpener-732ddc5a869d77de3f910ca12c40797f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/l 2023-07-15 09:11:05,109 INFO [StoreOpener-732ddc5a869d77de3f910ca12c40797f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 732ddc5a869d77de3f910ca12c40797f columnFamilyName l 2023-07-15 09:11:05,110 INFO [StoreOpener-732ddc5a869d77de3f910ca12c40797f-1] regionserver.HStore(310): Store=732ddc5a869d77de3f910ca12c40797f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:05,112 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,119 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:11:05,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:05,132 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 732ddc5a869d77de3f910ca12c40797f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70002267, jitterRate=0.04311506450176239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:05,132 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 732ddc5a869d77de3f910ca12c40797f: 2023-07-15 09:11:05,134 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f., pid=11, masterSystemTime=1689412265094 2023-07-15 09:11:05,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:05,139 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:11:05,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=732ddc5a869d77de3f910ca12c40797f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:05,141 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689412265140"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412265140"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412265140"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412265140"}]},"ts":"1689412265140"} 2023-07-15 09:11:05,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 09:11:05,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 732ddc5a869d77de3f910ca12c40797f, server=jenkins-hbase4.apache.org,36901,1689412260724 in 208 msec 2023-07-15 09:11:05,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 09:11:05,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=732ddc5a869d77de3f910ca12c40797f, ASSIGN in 376 msec 2023-07-15 09:11:05,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:11:05,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412265164"}]},"ts":"1689412265164"} 2023-07-15 09:11:05,169 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 09:11:05,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:11:05,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 594 msec 2023-07-15 09:11:05,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 09:11:05,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 09:11:05,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 09:11:05,918 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:11:06,213 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:11:06,219 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44789_jobhistory____gu76zl/webapp 2023-07-15 09:11:06,384 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 09:11:06,384 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 09:11:06,384 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 09:11:06,387 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 09:11:06,453 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:06,750 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:07,171 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 09:11:07,206 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44789 2023-07-15 09:11:07,407 WARN [Listener at jenkins-hbase4.apache.org/35043] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:11:07,760 WARN [Listener at jenkins-hbase4.apache.org/35043] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 09:11:07,761 INFO [Listener at jenkins-hbase4.apache.org/35043] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:11:07,767 INFO [Listener at jenkins-hbase4.apache.org/35043] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41655_cluster____.y3rn9/webapp 2023-07-15 09:11:07,845 INFO [Listener at jenkins-hbase4.apache.org/35043] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 09:11:07,845 INFO [Listener at jenkins-hbase4.apache.org/35043] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 09:11:07,846 INFO [Listener at jenkins-hbase4.apache.org/35043] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 09:11:07,846 INFO [Listener at jenkins-hbase4.apache.org/35043] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 09:11:07,857 INFO [Listener at jenkins-hbase4.apache.org/35043] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:08,078 INFO [Listener at jenkins-hbase4.apache.org/35043] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:08,256 INFO [Listener at jenkins-hbase4.apache.org/35043] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:08,268 INFO [Listener at jenkins-hbase4.apache.org/35043] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41655 2023-07-15 09:11:08,954 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:11:09,007 WARN [Listener at jenkins-hbase4.apache.org/35779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:11:09,066 WARN [Listener at jenkins-hbase4.apache.org/35779] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 09:11:09,067 INFO [Listener at jenkins-hbase4.apache.org/35779] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:11:09,077 INFO [Listener at jenkins-hbase4.apache.org/35779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41699_node____.1f59c9/webapp 2023-07-15 09:11:09,167 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 09:11:09,167 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 09:11:09,167 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 09:11:09,167 INFO [Listener at jenkins-hbase4.apache.org/35779] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 09:11:09,177 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 09:11:09,179 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 09:11:09,180 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 09:11:09,187 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:09,217 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:09,322 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:09,340 INFO [Listener at jenkins-hbase4.apache.org/35779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41699 2023-07-15 09:11:09,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:09,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 09:11:09,382 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:09,382 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 09:11:09,383 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 09:11:09,383 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 09:11:09,383 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:09,383 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 09:11:09,383 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 09:11:09,383 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 09:11:09,659 WARN [Listener at jenkins-hbase4.apache.org/39797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 09:11:09,666 WARN [Listener at jenkins-hbase4.apache.org/39797] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 09:11:09,666 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 09:11:09,672 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36957_node____.29jyp6/webapp 2023-07-15 09:11:09,725 INFO [Listener at jenkins-hbase4.apache.org/39797] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 09:11:09,725 INFO [Listener at jenkins-hbase4.apache.org/39797] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 09:11:09,725 INFO [Listener at jenkins-hbase4.apache.org/39797] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 09:11:09,725 INFO [Listener at jenkins-hbase4.apache.org/39797] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 09:11:09,736 INFO [Listener at jenkins-hbase4.apache.org/39797] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:09,756 INFO [Listener at jenkins-hbase4.apache.org/39797] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:09,852 INFO [Listener at jenkins-hbase4.apache.org/39797] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 09:11:09,863 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36957 2023-07-15 09:11:09,887 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 09:11:09,889 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:09,955 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=711, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=176, AvailableMemoryMB=5223 2023-07-15 09:11:09,955 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=711 is superior to 500 2023-07-15 09:11:09,968 DEBUG [Listener at jenkins-hbase4.apache.org/39797] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 09:11:09,974 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 09:11:09,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:09,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:09,986 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:11:09,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 09:11:09,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 09:11:09,988 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:11:09,993 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:09,993 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:09,994 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 empty. 2023-07-15 09:11:09,995 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 empty. 2023-07-15 09:11:09,997 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:09,999 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:09,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 09:11:10,038 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:10,040 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 20d6e97f23c2217be4b17ff551130791, NAME => 'testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:10,041 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 19ed1bf6da1f923965c700024f41b134, NAME => 'testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:10,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 09:11:10,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:10,110 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 20d6e97f23c2217be4b17ff551130791, disabling compactions & flushes 2023-07-15 09:11:10,110 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,110 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,110 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. after waiting 0 ms 2023-07-15 09:11:10,110 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,110 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,110 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 20d6e97f23c2217be4b17ff551130791: 2023-07-15 09:11:10,119 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:10,119 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 19ed1bf6da1f923965c700024f41b134, disabling compactions & flushes 2023-07-15 09:11:10,119 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,120 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,120 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. after waiting 0 ms 2023-07-15 09:11:10,120 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,120 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,120 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 19ed1bf6da1f923965c700024f41b134: 2023-07-15 09:11:10,127 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:11:10,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412270129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412270129"}]},"ts":"1689412270129"} 2023-07-15 09:11:10,129 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412270129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412270129"}]},"ts":"1689412270129"} 2023-07-15 09:11:10,191 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:11:10,192 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:11:10,193 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412270193"}]},"ts":"1689412270193"} 2023-07-15 09:11:10,195 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 09:11:10,201 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:11:10,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:11:10,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:11:10,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:11:10,203 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:11:10,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, ASSIGN}] 2023-07-15 09:11:10,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, ASSIGN 2023-07-15 09:11:10,207 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, ASSIGN 2023-07-15 09:11:10,209 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40347,1689412260661; forceNewPlan=false, retain=false 2023-07-15 09:11:10,209 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44901,1689412260598; forceNewPlan=false, retain=false 2023-07-15 09:11:10,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 09:11:10,360 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:11:10,363 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=19ed1bf6da1f923965c700024f41b134, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:10,363 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=20d6e97f23c2217be4b17ff551130791, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:10,363 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412270363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412270363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412270363"}]},"ts":"1689412270363"} 2023-07-15 09:11:10,363 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412270363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412270363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412270363"}]},"ts":"1689412270363"} 2023-07-15 09:11:10,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 19ed1bf6da1f923965c700024f41b134, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:11:10,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 20d6e97f23c2217be4b17ff551130791, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:11:10,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19ed1bf6da1f923965c700024f41b134, NAME => 'testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. service=AccessControlService 2023-07-15 09:11:10,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20d6e97f23c2217be4b17ff551130791, NAME => 'testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. service=AccessControlService 2023-07-15 09:11:10,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:10,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:10,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,529 INFO [StoreOpener-19ed1bf6da1f923965c700024f41b134-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,530 INFO [StoreOpener-20d6e97f23c2217be4b17ff551130791-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,532 DEBUG [StoreOpener-19ed1bf6da1f923965c700024f41b134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf 2023-07-15 09:11:10,532 DEBUG [StoreOpener-19ed1bf6da1f923965c700024f41b134-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf 2023-07-15 09:11:10,532 DEBUG [StoreOpener-20d6e97f23c2217be4b17ff551130791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf 2023-07-15 09:11:10,532 DEBUG [StoreOpener-20d6e97f23c2217be4b17ff551130791-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf 2023-07-15 09:11:10,532 INFO [StoreOpener-19ed1bf6da1f923965c700024f41b134-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19ed1bf6da1f923965c700024f41b134 columnFamilyName cf 2023-07-15 09:11:10,532 INFO [StoreOpener-20d6e97f23c2217be4b17ff551130791-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20d6e97f23c2217be4b17ff551130791 columnFamilyName cf 2023-07-15 09:11:10,533 INFO [StoreOpener-19ed1bf6da1f923965c700024f41b134-1] regionserver.HStore(310): Store=19ed1bf6da1f923965c700024f41b134/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:10,535 INFO [StoreOpener-20d6e97f23c2217be4b17ff551130791-1] regionserver.HStore(310): Store=20d6e97f23c2217be4b17ff551130791/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:10,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:10,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:10,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:10,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20d6e97f23c2217be4b17ff551130791; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68122520, jitterRate=0.01510465145111084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:10,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20d6e97f23c2217be4b17ff551130791: 2023-07-15 09:11:10,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791., pid=16, masterSystemTime=1689412270522 2023-07-15 09:11:10,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:10,554 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=20d6e97f23c2217be4b17ff551130791, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:10,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412270554"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412270554"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412270554"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412270554"}]},"ts":"1689412270554"} 2023-07-15 09:11:10,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:10,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19ed1bf6da1f923965c700024f41b134; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63264482, jitterRate=-0.05728575587272644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:10,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19ed1bf6da1f923965c700024f41b134: 2023-07-15 09:11:10,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134., pid=15, masterSystemTime=1689412270520 2023-07-15 09:11:10,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:10,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-15 09:11:10,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 20d6e97f23c2217be4b17ff551130791, server=jenkins-hbase4.apache.org,40347,1689412260661 in 194 msec 2023-07-15 09:11:10,570 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=19ed1bf6da1f923965c700024f41b134, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:10,570 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412270570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412270570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412270570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412270570"}]},"ts":"1689412270570"} 2023-07-15 09:11:10,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, ASSIGN in 367 msec 2023-07-15 09:11:10,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-15 09:11:10,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 19ed1bf6da1f923965c700024f41b134, server=jenkins-hbase4.apache.org,44901,1689412260598 in 207 msec 2023-07-15 09:11:10,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-15 09:11:10,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, ASSIGN in 376 msec 2023-07-15 09:11:10,584 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:11:10,584 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412270584"}]},"ts":"1689412270584"} 2023-07-15 09:11:10,586 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 09:11:10,589 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:11:10,595 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 09:11:10,605 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:10,609 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:10,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 09:11:10,625 DEBUG [hconnection-0x473faf76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:10,629 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-15 09:11:10,640 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 09:11:10,678 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:10,678 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:10,678 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:11:10,679 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:10,684 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:10,690 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:10,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:10,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:10,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:10,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 712 msec 2023-07-15 09:11:11,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 09:11:11,114 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 09:11:11,115 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-15 09:11:11,116 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:11,120 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-15 09:11:11,121 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:11,121 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-15 09:11:11,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 09:11:11,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412271137 (current time:1689412271137). 2023-07-15 09:11:11,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:11:11,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x6f2cf201 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:11,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23b66982, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:11,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,151 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f2cf201 to 127.0.0.1:64993 2023-07-15 09:11:11,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:11,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x768f9ba2 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:11,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2641ded7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:11,172 DEBUG [hconnection-0x32c4aa3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,173 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,182 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x768f9ba2 to 127.0.0.1:64993 2023-07-15 09:11:11,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:11,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 09:11:11,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:11:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 09:11:11,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 09:11:11,233 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 09:11:11,235 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689412871235 2023-07-15 09:11:11,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 09:11:11,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 09:11:11,238 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 09:11:11,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 09:11:11,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-15 09:11:11,243 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 09:11:11,245 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:11:11,245 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:11:11,245 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689412871245 2023-07-15 09:11:11,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,291 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 09:11:11,291 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:11,293 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 09:11:11,294 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 09:11:11,295 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,295 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,301 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:11,301 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:11,301 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:11,301 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:11,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:11,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,302 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,302 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,304 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 09:11:11,304 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 09:11:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 09:11:11,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 09:11:11,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 09:11:11,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 09:11:11,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,308 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 09:11:11,308 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:11,312 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 09:11:11,312 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 09:11:11,312 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 09:11:11,312 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 09:11:11,312 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:11,313 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 09:11:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 09:11:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 09:11:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 09:11:11,314 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 09:11:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 09:11:11,315 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 09:11:11,318 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,318 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:11,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:11,319 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,319 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 09:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1178de3a[Count = 1] remaining members to acquire global barrier 2023-07-15 09:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:11,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:11,324 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,324 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,325 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:11,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:11,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:11,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 09:11:11,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1178de3a[Count = 0] remaining members to acquire global barrier 2023-07-15 09:11:11,330 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 09:11:11,330 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,333 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 09:11:11,333 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 09:11:11,333 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,334 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 09:11:11,334 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 09:11:11,334 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:11:11,335 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:11,335 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:11,335 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:11,335 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:11,335 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:11,335 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:11,335 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. started... 2023-07-15 09:11:11,335 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. started... 2023-07-15 09:11:11,336 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,336 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:11:11,339 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20d6e97f23c2217be4b17ff551130791: 2023-07-15 09:11:11,339 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19ed1bf6da1f923965c700024f41b134: 2023-07-15 09:11:11,341 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,341 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 09:11:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 09:11:11,345 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:11,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 09:11:11,349 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:11,349 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:11,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:11,350 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:11:11,353 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:11:11,353 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:11:11,412 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. completed. 2023-07-15 09:11:11,412 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 09:11:11,413 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:11:11,416 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. completed. 2023-07-15 09:11:11,416 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 09:11:11,416 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:11:11,417 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,418 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 09:11:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,418 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:11,418 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 09:11:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:11,421 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,421 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 09:11:11,421 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:11,421 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 09:11:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:11,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:11,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:11:11,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 09:11:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:11,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:11:11,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 09:11:11,433 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 09:11:11,433 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:11:11,433 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:11:11,433 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,433 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:11:11,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:11,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:11,436 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,437 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:11,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:11,437 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:11,438 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,438 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:11,441 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,441 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,441 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:11,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:11,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,455 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:11,456 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:11,456 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,456 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:11,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:11,455 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:11,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,456 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,460 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:11,460 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,460 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:11,460 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:11,460 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,460 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:11,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:11,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:11,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:11,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:11,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,551 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:11,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 09:11:11,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:11,553 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:11:11,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 09:11:11,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,576 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:11,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689412271235Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689412271456 (+221 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689412271457 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689412271472 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689412271508 (+36 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689412271576 (+68 ms) 2023-07-15 09:11:11,578 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 09:11:11,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 339 msec 2023-07-15 09:11:11,854 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:11,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 09:11:11,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:11:11,881 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,884 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40347] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:11:11,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44901] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:11:11,891 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 09:11:11,893 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:11,895 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:11,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 09:11:11,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412271928 (current time:1689412271928). 2023-07-15 09:11:11,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:11:11,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x77dd7e36 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:11,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d684e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:11,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,948 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77dd7e36 to 127.0.0.1:64993 2023-07-15 09:11:11,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:11,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x2f5fb840 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:11,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@336f5f53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:11,959 DEBUG [hconnection-0x47ea1c6c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,962 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:11,969 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:11,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f5fb840 to 127.0.0.1:64993 2023-07-15 09:11:11,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:11,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 09:11:11,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:11:11,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 09:11:11,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 09:11:11,978 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 09:11:11,979 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689412871979 2023-07-15 09:11:11,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 09:11:11,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 09:11:11,981 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:11:11,981 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:11:11,983 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 09:11:11,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 09:11:11,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-15 09:11:11,987 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 09:11:11,988 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689412871988 2023-07-15 09:11:12,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 09:11:12,015 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 09:11:12,015 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:12,017 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 09:11:12,017 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 09:11:12,017 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,018 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,019 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,019 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:12,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:12,020 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:12,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:12,020 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:12,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,021 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,021 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 09:11:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 09:11:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 09:11:12,022 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,022 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:11:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 09:11:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 09:11:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 09:11:12,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 09:11:12,024 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 09:11:12,024 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:12,026 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 09:11:12,026 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 09:11:12,026 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 09:11:12,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 09:11:12,027 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 09:11:12,027 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:12,029 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 09:11:12,029 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 09:11:12,029 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 09:11:12,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 09:11:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 09:11:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 09:11:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 09:11:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 09:11:12,037 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,037 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:12,039 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,040 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,040 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:12,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 09:11:12,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c7bffd3[Count = 1] remaining members to acquire global barrier 2023-07-15 09:11:12,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:12,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:12,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:12,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:12,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:12,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 09:11:12,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c7bffd3[Count = 0] remaining members to acquire global barrier 2023-07-15 09:11:12,049 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 09:11:12,049 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 09:11:12,053 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:12,053 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:11:12,053 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:12,053 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:11:12,054 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. started... 2023-07-15 09:11:12,054 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 19ed1bf6da1f923965c700024f41b134 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 09:11:12,058 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:12,060 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:12,060 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 09:11:12,060 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:12,060 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 09:11:12,061 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:12,061 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. started... 2023-07-15 09:11:12,061 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20d6e97f23c2217be4b17ff551130791 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 09:11:12,081 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:12,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 09:11:12,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:12,083 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:11:12,162 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/.tmp/cf/327b098e86434163b89bdd9fd7a45767 2023-07-15 09:11:12,167 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/.tmp/cf/2f60c4802acf42c29540d25d3ff07c40 2023-07-15 09:11:12,216 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/.tmp/cf/2f60c4802acf42c29540d25d3ff07c40 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf/2f60c4802acf42c29540d25d3ff07c40 2023-07-15 09:11:12,216 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/.tmp/cf/327b098e86434163b89bdd9fd7a45767 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf/327b098e86434163b89bdd9fd7a45767 2023-07-15 09:11:12,225 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf/2f60c4802acf42c29540d25d3ff07c40, entries=44, sequenceid=6, filesize=7.8 K 2023-07-15 09:11:12,227 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf/327b098e86434163b89bdd9fd7a45767, entries=6, sequenceid=6, filesize=5.2 K 2023-07-15 09:11:12,235 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 19ed1bf6da1f923965c700024f41b134 in 181ms, sequenceid=6, compaction requested=false 2023-07-15 09:11:12,235 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 20d6e97f23c2217be4b17ff551130791 in 174ms, sequenceid=6, compaction requested=false 2023-07-15 09:11:12,235 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 09:11:12,235 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 09:11:12,239 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20d6e97f23c2217be4b17ff551130791: 2023-07-15 09:11:12,239 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19ed1bf6da1f923965c700024f41b134: 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf/327b098e86434163b89bdd9fd7a45767] hfiles 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf/327b098e86434163b89bdd9fd7a45767 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf/2f60c4802acf42c29540d25d3ff07c40] hfiles 2023-07-15 09:11:12,240 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf/2f60c4802acf42c29540d25d3ff07c40 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 09:11:12,284 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:12,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 09:11:12,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:12,286 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:11:12,292 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. completed. 2023-07-15 09:11:12,292 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:11:12,293 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. completed. 2023-07-15 09:11:12,293 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,293 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 09:11:12,294 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:11:12,296 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,297 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 09:11:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:12,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:12,297 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:12,297 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 09:11:12,298 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 09:11:12,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:12,298 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:12,298 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,298 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 09:11:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:11:12,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 09:11:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:12,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:12,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:11:12,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 09:11:12,308 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 09:11:12,308 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:11:12,308 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:11:12,308 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 09:11:12,308 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:12,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:12,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,311 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:12,313 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,314 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,315 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 09:11:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,318 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,319 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,319 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,339 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:12,339 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:12,339 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:12,339 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:12,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:12,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:12,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:12,339 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:12,339 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:12,339 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:12,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:12,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:12,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 09:11:12,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 09:11:12,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:12,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:12,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:12,341 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,342 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:12,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:12,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:12,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:12,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 09:11:12,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,471 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 09:11:12,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689412271980Consolidate snapshot: snaptb0-testExportWithTargetName at 1689412272341 (+361 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689412272341Writing data manifest for snaptb0-testExportWithTargetName at 1689412272360 (+19 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689412272385 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689412272471 (+86 ms) 2023-07-15 09:11:12,474 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 09:11:12,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 493 msec 2023-07-15 09:11:12,586 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:12,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 09:11:12,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:11:12,590 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590 2023-07-15 09:11:12,590 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38909, tgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590, rawTgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:12,643 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:12,643 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-928903643_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 09:11:12,643 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 09:11:12,662 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 09:11:12,727 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,727 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,728 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,728 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,729 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,729 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,730 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,807 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-2965608664050490153.jar 2023-07-15 09:11:12,808 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,808 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,809 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,809 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,809 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,810 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:12,810 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:11:12,811 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:11:12,811 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:11:12,811 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:11:12,812 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:11:12,812 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:11:12,813 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:11:12,813 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:11:12,814 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:11:12,814 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:11:12,817 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:12,818 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:12,818 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:12,818 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:12,818 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:12,819 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:12,819 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:13,962 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:11:13,967 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 09:11:13,976 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 09:11:14,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:11:14,434 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:11:14,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0001_000001 (auth:SIMPLE) 2023-07-15 09:11:16,042 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:11:20,198 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0001_000001 (auth:SIMPLE) 2023-07-15 09:11:22,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0001_000001 (auth:SIMPLE) 2023-07-15 09:11:26,874 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:11:26,877 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:11:26,887 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 09:11:26,887 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:11:26,888 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:11:26,888 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 09:11:26,889 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 09:11:26,889 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 09:11:26,889 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590/.hbase-snapshot/testExportWithTargetName 2023-07-15 09:11:26,890 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 09:11:26,890 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412272590/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 09:11:26,900 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 09:11:26,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 09:11:26,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:26,918 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412286918"}]},"ts":"1689412286918"} 2023-07-15 09:11:26,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 09:11:26,920 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 09:11:26,958 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 09:11:26,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, UNASSIGN}] 2023-07-15 09:11:26,963 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, UNASSIGN 2023-07-15 09:11:26,963 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, UNASSIGN 2023-07-15 09:11:26,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=20d6e97f23c2217be4b17ff551130791, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:26,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=19ed1bf6da1f923965c700024f41b134, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:26,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412286964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412286964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412286964"}]},"ts":"1689412286964"} 2023-07-15 09:11:26,965 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412286964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412286964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412286964"}]},"ts":"1689412286964"} 2023-07-15 09:11:26,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 20d6e97f23c2217be4b17ff551130791, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:11:26,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 19ed1bf6da1f923965c700024f41b134, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:11:27,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 09:11:27,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:27,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19ed1bf6da1f923965c700024f41b134, disabling compactions & flushes 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20d6e97f23c2217be4b17ff551130791, disabling compactions & flushes 2023-07-15 09:11:27,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:27,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. after waiting 0 ms 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. after waiting 0 ms 2023-07-15 09:11:27,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:11:27,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:11:27,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:27,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:27,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134. 2023-07-15 09:11:27,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791. 2023-07-15 09:11:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19ed1bf6da1f923965c700024f41b134: 2023-07-15 09:11:27,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20d6e97f23c2217be4b17ff551130791: 2023-07-15 09:11:27,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:27,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=20d6e97f23c2217be4b17ff551130791, regionState=CLOSED 2023-07-15 09:11:27,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412287152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412287152"}]},"ts":"1689412287152"} 2023-07-15 09:11:27,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:27,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=19ed1bf6da1f923965c700024f41b134, regionState=CLOSED 2023-07-15 09:11:27,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689412287156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412287156"}]},"ts":"1689412287156"} 2023-07-15 09:11:27,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-15 09:11:27,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 20d6e97f23c2217be4b17ff551130791, server=jenkins-hbase4.apache.org,40347,1689412260661 in 187 msec 2023-07-15 09:11:27,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=20d6e97f23c2217be4b17ff551130791, UNASSIGN in 197 msec 2023-07-15 09:11:27,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-15 09:11:27,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 19ed1bf6da1f923965c700024f41b134, server=jenkins-hbase4.apache.org,44901,1689412260598 in 190 msec 2023-07-15 09:11:27,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-15 09:11:27,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=19ed1bf6da1f923965c700024f41b134, UNASSIGN in 201 msec 2023-07-15 09:11:27,165 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412287164"}]},"ts":"1689412287164"} 2023-07-15 09:11:27,166 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 09:11:27,188 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 09:11:27,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 282 msec 2023-07-15 09:11:27,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 09:11:27,223 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 09:11:27,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 09:11:27,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:27,239 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:27,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 09:11:27,241 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:27,245 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 09:11:27,247 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:27,247 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:27,251 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/recovered.edits] 2023-07-15 09:11:27,251 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/recovered.edits] 2023-07-15 09:11:27,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf/327b098e86434163b89bdd9fd7a45767 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/cf/327b098e86434163b89bdd9fd7a45767 2023-07-15 09:11:27,258 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf/2f60c4802acf42c29540d25d3ff07c40 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/cf/2f60c4802acf42c29540d25d3ff07c40 2023-07-15 09:11:27,262 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791/recovered.edits/9.seqid 2023-07-15 09:11:27,263 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134/recovered.edits/9.seqid 2023-07-15 09:11:27,263 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/20d6e97f23c2217be4b17ff551130791 2023-07-15 09:11:27,264 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportWithTargetName/19ed1bf6da1f923965c700024f41b134 2023-07-15 09:11:27,264 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 09:11:27,267 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:27,287 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 09:11:27,290 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 09:11:27,292 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:27,292 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 09:11:27,292 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412287292"}]},"ts":"9223372036854775807"} 2023-07-15 09:11:27,292 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412287292"}]},"ts":"9223372036854775807"} 2023-07-15 09:11:27,295 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 09:11:27,295 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 20d6e97f23c2217be4b17ff551130791, NAME => 'testtb-testExportWithTargetName,,1689412269980.20d6e97f23c2217be4b17ff551130791.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 19ed1bf6da1f923965c700024f41b134, NAME => 'testtb-testExportWithTargetName,1,1689412269980.19ed1bf6da1f923965c700024f41b134.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 09:11:27,295 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 09:11:27,295 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412287295"}]},"ts":"9223372036854775807"} 2023-07-15 09:11:27,297 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 09:11:27,304 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 09:11:27,304 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 09:11:27,304 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 09:11:27,304 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 09:11:27,344 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 09:11:27,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 115 msec 2023-07-15 09:11:27,389 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:27,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 09:11:27,389 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 09:11:27,389 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:27,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 09:11:27,389 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 09:11:27,389 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:27,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 09:11:27,390 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 09:11:27,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 09:11:27,390 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:27,390 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 09:11:27,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 09:11:27,393 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 09:11:27,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 09:11:27,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 09:11:27,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 09:11:27,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 09:11:27,448 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 711) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-69854517_17 at /127.0.0.1:59294 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:40697 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:56274 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:37068 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:45209 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1819664948_1 at /127.0.0.1:59258 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=347 (was 304) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=3516 (was 5223) 2023-07-15 09:11:27,448 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-15 09:11:27,469 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=182, AvailableMemoryMB=3515 2023-07-15 09:11:27,469 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-15 09:11:27,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:27,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:27,476 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:11:27,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 09:11:27,478 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:11:27,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 09:11:27,481 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,481 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,481 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 empty. 2023-07-15 09:11:27,481 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb empty. 2023-07-15 09:11:27,482 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,482 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,482 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 09:11:27,499 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:27,500 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f2af8996556a7b89127e29a177f0e7cb, NAME => 'testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:27,501 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 759c3bd43f90baa082695901d71a74a1, NAME => 'testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:27,529 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:27,530 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f2af8996556a7b89127e29a177f0e7cb, disabling compactions & flushes 2023-07-15 09:11:27,530 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,530 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,530 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. after waiting 0 ms 2023-07-15 09:11:27,530 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,530 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,530 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f2af8996556a7b89127e29a177f0e7cb: 2023-07-15 09:11:27,534 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:27,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 759c3bd43f90baa082695901d71a74a1, disabling compactions & flushes 2023-07-15 09:11:27,535 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. after waiting 0 ms 2023-07-15 09:11:27,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,535 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,535 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 759c3bd43f90baa082695901d71a74a1: 2023-07-15 09:11:27,538 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:11:27,539 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412287538"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412287538"}]},"ts":"1689412287538"} 2023-07-15 09:11:27,539 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412287538"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412287538"}]},"ts":"1689412287538"} 2023-07-15 09:11:27,542 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:11:27,543 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:11:27,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412287543"}]},"ts":"1689412287543"} 2023-07-15 09:11:27,545 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 09:11:27,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 09:11:27,619 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:11:27,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:11:27,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:11:27,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:11:27,621 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:11:27,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, ASSIGN}] 2023-07-15 09:11:27,624 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, ASSIGN 2023-07-15 09:11:27,624 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, ASSIGN 2023-07-15 09:11:27,626 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36901,1689412260724; forceNewPlan=false, retain=false 2023-07-15 09:11:27,626 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40347,1689412260661; forceNewPlan=false, retain=false 2023-07-15 09:11:27,776 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:11:27,779 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=759c3bd43f90baa082695901d71a74a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:27,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f2af8996556a7b89127e29a177f0e7cb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:27,779 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412287779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412287779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412287779"}]},"ts":"1689412287779"} 2023-07-15 09:11:27,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412287779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412287779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412287779"}]},"ts":"1689412287779"} 2023-07-15 09:11:27,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 09:11:27,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 759c3bd43f90baa082695901d71a74a1, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:11:27,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure f2af8996556a7b89127e29a177f0e7cb, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:11:27,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 759c3bd43f90baa082695901d71a74a1, NAME => 'testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 09:11:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. service=AccessControlService 2023-07-15 09:11:27,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2af8996556a7b89127e29a177f0e7cb, NAME => 'testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 09:11:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. service=AccessControlService 2023-07-15 09:11:27,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:27,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:27,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,945 INFO [StoreOpener-759c3bd43f90baa082695901d71a74a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,947 DEBUG [StoreOpener-759c3bd43f90baa082695901d71a74a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf 2023-07-15 09:11:27,947 DEBUG [StoreOpener-759c3bd43f90baa082695901d71a74a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf 2023-07-15 09:11:27,947 INFO [StoreOpener-f2af8996556a7b89127e29a177f0e7cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,948 INFO [StoreOpener-759c3bd43f90baa082695901d71a74a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 759c3bd43f90baa082695901d71a74a1 columnFamilyName cf 2023-07-15 09:11:27,949 INFO [StoreOpener-759c3bd43f90baa082695901d71a74a1-1] regionserver.HStore(310): Store=759c3bd43f90baa082695901d71a74a1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:27,949 DEBUG [StoreOpener-f2af8996556a7b89127e29a177f0e7cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf 2023-07-15 09:11:27,951 DEBUG [StoreOpener-f2af8996556a7b89127e29a177f0e7cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf 2023-07-15 09:11:27,951 INFO [StoreOpener-f2af8996556a7b89127e29a177f0e7cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2af8996556a7b89127e29a177f0e7cb columnFamilyName cf 2023-07-15 09:11:27,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,952 INFO [StoreOpener-f2af8996556a7b89127e29a177f0e7cb-1] regionserver.HStore(310): Store=f2af8996556a7b89127e29a177f0e7cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:27,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:27,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:27,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:27,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:27,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2af8996556a7b89127e29a177f0e7cb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65983637, jitterRate=-0.016767188906669617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:27,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 759c3bd43f90baa082695901d71a74a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74239051, jitterRate=0.10624806582927704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:27,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2af8996556a7b89127e29a177f0e7cb: 2023-07-15 09:11:27,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 759c3bd43f90baa082695901d71a74a1: 2023-07-15 09:11:27,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1., pid=30, masterSystemTime=1689412287933 2023-07-15 09:11:27,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb., pid=31, masterSystemTime=1689412287934 2023-07-15 09:11:27,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:27,970 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f2af8996556a7b89127e29a177f0e7cb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:27,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,970 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412287970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412287970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412287970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412287970"}]},"ts":"1689412287970"} 2023-07-15 09:11:27,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:27,971 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=759c3bd43f90baa082695901d71a74a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:27,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412287971"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412287971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412287971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412287971"}]},"ts":"1689412287971"} 2023-07-15 09:11:27,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-15 09:11:27,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure f2af8996556a7b89127e29a177f0e7cb, server=jenkins-hbase4.apache.org,36901,1689412260724 in 191 msec 2023-07-15 09:11:27,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-15 09:11:27,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 759c3bd43f90baa082695901d71a74a1, server=jenkins-hbase4.apache.org,40347,1689412260661 in 193 msec 2023-07-15 09:11:27,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, ASSIGN in 356 msec 2023-07-15 09:11:27,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-15 09:11:27,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, ASSIGN in 358 msec 2023-07-15 09:11:27,983 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:11:27,983 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412287983"}]},"ts":"1689412287983"} 2023-07-15 09:11:27,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 09:11:28,036 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:11:28,037 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 09:11:28,042 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 09:11:28,065 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:28,065 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:28,065 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:28,065 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:28,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 09:11:28,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:28,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:28,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:28,097 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:28,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 623 msec 2023-07-15 09:11:28,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 09:11:28,584 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 09:11:28,584 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 09:11:28,584 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:28,591 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 09:11:28,591 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:28,592 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-15 09:11:28,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:11:28,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412288603 (current time:1689412288603). 2023-07-15 09:11:28,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:11:28,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x3692ca93 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:28,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ed467a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:28,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:28,692 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:28,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3692ca93 to 127.0.0.1:64993 2023-07-15 09:11:28,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:28,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x1ea39560 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:28,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e450275, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:28,752 DEBUG [hconnection-0x45e04d51-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:28,755 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:28,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:28,760 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:28,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ea39560 to 127.0.0.1:64993 2023-07-15 09:11:28,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:28,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 09:11:28,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:11:28,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:11:28,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:11:28,767 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:11:28,768 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689412888768 2023-07-15 09:11:28,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:11:28,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 09:11:28,769 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:11:28,769 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:11:28,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 09:11:28,771 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:11:28,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 09:11:28,773 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 09:11:28,774 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689412888774 2023-07-15 09:11:28,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,787 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 09:11:28,787 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:28,789 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 09:11:28,789 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 09:11:28,796 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,796 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,850 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:28,850 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:28,850 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:28,850 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:28,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:28,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:28,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:28,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:28,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:28,850 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:28,851 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,851 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:28,851 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,852 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 09:11:28,852 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 09:11:28,852 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:28,852 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:28,852 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 09:11:28,855 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 09:11:28,855 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 09:11:28,855 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:28,854 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 09:11:28,856 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 09:11:28,855 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 09:11:28,856 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 09:11:28,856 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 09:11:28,856 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 09:11:28,856 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 09:11:28,869 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:28,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:11:28,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:28,871 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:11:28,983 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,983 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,983 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:28,983 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:28,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:28,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:28,983 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:28,984 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,984 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:28,984 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,984 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,984 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:28,984 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:28,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:28,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:28,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@148c411b[Count = 1] remaining members to acquire global barrier 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:28,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:28,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:28,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:28,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 09:11:28,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@148c411b[Count = 0] remaining members to acquire global barrier 2023-07-15 09:11:28,989 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 09:11:28,990 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,019 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:11:29,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:29,020 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:29,020 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. started... 2023-07-15 09:11:29,020 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:11:29,020 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. started... 2023-07-15 09:11:29,020 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,022 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 759c3bd43f90baa082695901d71a74a1: 2023-07-15 09:11:29,022 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:11:29,020 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:29,023 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2af8996556a7b89127e29a177f0e7cb: 2023-07-15 09:11:29,023 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,023 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:29,023 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,024 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:11:29,024 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:29,024 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:11:29,037 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. completed. 2023-07-15 09:11:29,037 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 09:11:29,038 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:11:29,038 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. completed. 2023-07-15 09:11:29,038 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:29,038 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:29,038 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:29,038 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,038 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 09:11:29,038 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:11:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 09:11:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 09:11:29,071 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:29,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:11:29,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:29,073 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:11:29,081 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 09:11:29,081 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 09:11:29,081 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,081 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,081 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,081 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,081 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 09:11:29,082 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 09:11:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:11:29,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 09:11:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:11:29,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 09:11:29,092 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 09:11:29,092 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:11:29,092 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:11:29,092 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,092 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:11:29,142 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,142 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,142 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,142 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,143 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,142 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,144 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,144 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,146 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,147 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,147 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,180 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,180 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,181 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:29,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:29,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,181 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:29,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,182 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,183 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 09:11:29,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,235 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:29,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689412288768Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689412289183 (+415 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689412289183Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689412289187 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689412289200 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689412289235 (+35 ms) 2023-07-15 09:11:29,238 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 09:11:29,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 469 msec 2023-07-15 09:11:29,373 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:29,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:11:29,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:11:29,384 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:29,390 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:29,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36901] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:11:29,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40347] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:11:29,397 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 09:11:29,397 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:29,399 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:29,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:11:29,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412289415 (current time:1689412289415). 2023-07-15 09:11:29,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:11:29,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x71faee17 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:29,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d7a1ab0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:29,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:29,479 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:29,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71faee17 to 127.0.0.1:64993 2023-07-15 09:11:29,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:29,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x2cedff53 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:29,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@670302fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:29,591 DEBUG [hconnection-0x1bdf77b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:29,593 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:29,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:29,600 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:29,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cedff53 to 127.0.0.1:64993 2023-07-15 09:11:29,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:29,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 09:11:29,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:11:29,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:11:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:11:29,606 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:11:29,607 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689412889607 2023-07-15 09:11:29,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 09:11:29,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:11:29,608 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:11:29,608 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:11:29,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 09:11:29,611 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:11:29,614 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 09:11:29,615 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 09:11:29,616 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689412889616 2023-07-15 09:11:29,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 09:11:29,647 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 09:11:29,647 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:29,649 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 09:11:29,649 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 09:11:29,650 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,650 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,681 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:29,681 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:29,681 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:29,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:29,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:29,681 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:29,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,682 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,682 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,683 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,683 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:11:29,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 09:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 09:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 09:11:29,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 09:11:29,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 09:11:29,691 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 09:11:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 09:11:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:29,692 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:29,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 09:11:29,693 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 09:11:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 09:11:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 09:11:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 09:11:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 09:11:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 09:11:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 09:11:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 09:11:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 09:11:29,695 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 09:11:29,708 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:29,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:11:29,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:29,710 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:11:29,711 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,711 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,734 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,735 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,735 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,735 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:29,735 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,737 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:29,738 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,738 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 09:11:29,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93112c3[Count = 1] remaining members to acquire global barrier 2023-07-15 09:11:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 09:11:29,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93112c3[Count = 0] remaining members to acquire global barrier 2023-07-15 09:11:29,747 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 09:11:29,748 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,781 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:11:29,781 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:11:29,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,781 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,781 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:11:29,781 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:29,781 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:29,782 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:29,782 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:29,782 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. started... 2023-07-15 09:11:29,782 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. started... 2023-07-15 09:11:29,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:11:29,782 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f2af8996556a7b89127e29a177f0e7cb 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 09:11:29,782 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 759c3bd43f90baa082695901d71a74a1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 09:11:29,781 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 09:11:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:11:29,799 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/.tmp/cf/b583a84a52604424b145e7f98718028f 2023-07-15 09:11:29,804 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 09:11:29,804 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,804 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 09:11:29,805 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/.tmp/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1 2023-07-15 09:11:29,811 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/.tmp/cf/b583a84a52604424b145e7f98718028f as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf/b583a84a52604424b145e7f98718028f 2023-07-15 09:11:29,815 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/.tmp/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1 2023-07-15 09:11:29,817 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf/b583a84a52604424b145e7f98718028f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-15 09:11:29,820 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f2af8996556a7b89127e29a177f0e7cb in 38ms, sequenceid=6, compaction requested=false 2023-07-15 09:11:29,820 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 09:11:29,820 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2af8996556a7b89127e29a177f0e7cb: 2023-07-15 09:11:29,821 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 09:11:29,821 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:29,821 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf/b583a84a52604424b145e7f98718028f] hfiles 2023-07-15 09:11:29,821 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf/b583a84a52604424b145e7f98718028f for snapshot=snaptb0-testExportFileSystemState 2023-07-15 09:11:29,823 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1, entries=47, sequenceid=6, filesize=8.0 K 2023-07-15 09:11:29,825 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 759c3bd43f90baa082695901d71a74a1 in 43ms, sequenceid=6, compaction requested=false 2023-07-15 09:11:29,827 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 759c3bd43f90baa082695901d71a74a1: 2023-07-15 09:11:29,827 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 09:11:29,827 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:29,827 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1] hfiles 2023-07-15 09:11:29,827 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 09:11:29,837 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. completed. 2023-07-15 09:11:29,838 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 09:11:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:11:29,840 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. completed. 2023-07-15 09:11:29,840 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 09:11:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:11:29,907 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 09:11:29,907 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,907 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,907 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 09:11:29,910 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:29,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:11:29,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:29,911 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:11:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 09:11:29,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:29,958 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,958 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 09:11:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 09:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:29,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:11:29,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 09:11:29,966 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 09:11:29,966 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:11:29,966 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:11:29,966 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 09:11:29,966 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:11:29,996 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,996 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:29,996 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,996 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,996 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,997 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,996 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,997 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:29,998 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:29,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:29,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:29,999 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:29,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:30,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:30,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:30,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:30,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 09:11:30,001 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:30,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:30,001 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:30,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:30,002 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:30,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:30,034 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:30,034 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:30,035 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:30,035 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:30,034 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,034 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:30,035 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:30,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 09:11:30,035 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:30,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 09:11:30,035 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:30,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:30,035 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:30,035 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:30,037 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:30,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:30,037 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:30,037 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,037 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:30,038 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:30,038 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,038 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 09:11:30,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,085 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689412289607Consolidate snapshot: snaptb0-testExportFileSystemState at 1689412290035 (+428 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689412290037 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689412290041 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689412290055 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689412290084 (+29 ms) 2023-07-15 09:11:30,087 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 09:11:30,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 479 msec 2023-07-15 09:11:30,211 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:30,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:11:30,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:11:30,214 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214 2023-07-15 09:11:30,214 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38909, tgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214, rawTgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:30,247 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:30,247 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_544872147_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,247 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 09:11:30,259 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 09:11:30,721 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,722 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,722 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,722 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,723 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,723 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,723 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,796 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-1723064845650009385.jar 2023-07-15 09:11:30,797 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,797 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,797 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,798 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,798 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,798 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:30,799 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:11:30,799 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:11:30,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:11:30,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:11:30,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:11:30,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:11:30,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:11:30,802 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:11:30,802 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:11:30,802 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:11:30,803 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:30,803 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:30,804 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:30,804 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:30,804 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:30,804 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:30,805 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:31,309 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:11:31,312 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 09:11:31,314 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 09:11:31,538 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:11:31,538 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:11:31,544 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0001_000001 (auth:SIMPLE) 2023-07-15 09:11:31,895 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0002_000001 (auth:SIMPLE) 2023-07-15 09:11:32,756 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:11:36,679 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0002_000001 (auth:SIMPLE) 2023-07-15 09:11:38,902 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0002_000001 (auth:SIMPLE) 2023-07-15 09:11:41,604 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0002_000001 (auth:SIMPLE) 2023-07-15 09:11:43,545 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:11:43,546 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:11:43,553 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 09:11:43,553 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:11:43,553 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:11:43,553 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 09:11:43,554 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 09:11:43,554 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 09:11:43,554 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 09:11:43,554 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 09:11:43,554 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412290214/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 09:11:43,581 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 09:11:43,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 09:11:43,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 09:11:43,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412303586"}]},"ts":"1689412303586"} 2023-07-15 09:11:43,588 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 09:11:43,590 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 09:11:43,591 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, UNASSIGN}] 2023-07-15 09:11:43,593 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, UNASSIGN 2023-07-15 09:11:43,593 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, UNASSIGN 2023-07-15 09:11:43,594 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=759c3bd43f90baa082695901d71a74a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:43,594 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412303594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412303594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412303594"}]},"ts":"1689412303594"} 2023-07-15 09:11:43,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f2af8996556a7b89127e29a177f0e7cb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:43,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412303594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412303594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412303594"}]},"ts":"1689412303594"} 2023-07-15 09:11:43,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 759c3bd43f90baa082695901d71a74a1, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:11:43,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure f2af8996556a7b89127e29a177f0e7cb, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:11:43,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 09:11:43,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 759c3bd43f90baa082695901d71a74a1, disabling compactions & flushes 2023-07-15 09:11:43,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. after waiting 0 ms 2023-07-15 09:11:43,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:43,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:43,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2af8996556a7b89127e29a177f0e7cb, disabling compactions & flushes 2023-07-15 09:11:43,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:43,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:43,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. after waiting 0 ms 2023-07-15 09:11:43,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:43,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:11:43,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:11:43,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:43,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1. 2023-07-15 09:11:43,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 759c3bd43f90baa082695901d71a74a1: 2023-07-15 09:11:43,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:11:43,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb. 2023-07-15 09:11:43,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2af8996556a7b89127e29a177f0e7cb: 2023-07-15 09:11:43,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:43,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=759c3bd43f90baa082695901d71a74a1, regionState=CLOSED 2023-07-15 09:11:43,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412303766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412303766"}]},"ts":"1689412303766"} 2023-07-15 09:11:43,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:43,767 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f2af8996556a7b89127e29a177f0e7cb, regionState=CLOSED 2023-07-15 09:11:43,767 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689412303767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412303767"}]},"ts":"1689412303767"} 2023-07-15 09:11:43,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-15 09:11:43,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 759c3bd43f90baa082695901d71a74a1, server=jenkins-hbase4.apache.org,40347,1689412260661 in 173 msec 2023-07-15 09:11:43,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-15 09:11:43,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure f2af8996556a7b89127e29a177f0e7cb, server=jenkins-hbase4.apache.org,36901,1689412260724 in 172 msec 2023-07-15 09:11:43,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=759c3bd43f90baa082695901d71a74a1, UNASSIGN in 179 msec 2023-07-15 09:11:43,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 09:11:43,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f2af8996556a7b89127e29a177f0e7cb, UNASSIGN in 180 msec 2023-07-15 09:11:43,773 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412303773"}]},"ts":"1689412303773"} 2023-07-15 09:11:43,775 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 09:11:43,776 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 09:11:43,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 196 msec 2023-07-15 09:11:43,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 09:11:43,888 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 09:11:43,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 09:11:43,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 09:11:43,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,895 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 09:11:43,898 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,898 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,898 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,898 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 09:11:43,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 09:11:43,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 09:11:43,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 09:11:43,899 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:43,899 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:43,901 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/recovered.edits] 2023-07-15 09:11:43,901 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/recovered.edits] 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:43,906 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:43,906 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/cf/4c7ac7ab80d5495c8cdc885a5b7a8ae1 2023-07-15 09:11:43,906 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf/b583a84a52604424b145e7f98718028f to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/cf/b583a84a52604424b145e7f98718028f 2023-07-15 09:11:43,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 09:11:43,911 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1/recovered.edits/9.seqid 2023-07-15 09:11:43,911 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb/recovered.edits/9.seqid 2023-07-15 09:11:43,911 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/759c3bd43f90baa082695901d71a74a1 2023-07-15 09:11:43,912 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemState/f2af8996556a7b89127e29a177f0e7cb 2023-07-15 09:11:43,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 09:11:43,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,916 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 09:11:43,919 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 09:11:43,920 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,920 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 09:11:43,921 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412303920"}]},"ts":"9223372036854775807"} 2023-07-15 09:11:43,921 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412303920"}]},"ts":"9223372036854775807"} 2023-07-15 09:11:43,923 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 09:11:43,923 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f2af8996556a7b89127e29a177f0e7cb, NAME => 'testtb-testExportFileSystemState,,1689412287471.f2af8996556a7b89127e29a177f0e7cb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 759c3bd43f90baa082695901d71a74a1, NAME => 'testtb-testExportFileSystemState,1,1689412287471.759c3bd43f90baa082695901d71a74a1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 09:11:43,923 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 09:11:43,923 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412303923"}]},"ts":"9223372036854775807"} 2023-07-15 09:11:43,925 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 09:11:43,927 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 09:11:43,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-15 09:11:44,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 09:11:44,008 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 09:11:44,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 09:11:44,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 09:11:44,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 09:11:44,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 09:11:44,047 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 755) Potentially hanging thread: hconnection-0x6f656688-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-743491508_1 at /127.0.0.1:44400 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:41919 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:46242 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-743491508_1 at /127.0.0.1:46204 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:39672 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=379 (was 347) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=3275 (was 3515) 2023-07-15 09:11:44,047 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-15 09:11:44,067 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=379, ProcessCount=182, AvailableMemoryMB=3274 2023-07-15 09:11:44,067 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-15 09:11:44,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:11:44,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:11:44,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:11:44,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 09:11:44,073 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:11:44,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 09:11:44,075 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,075 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,076 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b empty. 2023-07-15 09:11:44,076 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 empty. 2023-07-15 09:11:44,076 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,076 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 09:11:44,087 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 09:11:44,089 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => dbf62160fc10af7e629bfbd8d5c5566b, NAME => 'testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:44,089 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 27fafc2afba386b6163b7d51b46551e5, NAME => 'testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:11:44,100 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:44,100 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing dbf62160fc10af7e629bfbd8d5c5566b, disabling compactions & flushes 2023-07-15 09:11:44,100 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,100 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,100 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. after waiting 0 ms 2023-07-15 09:11:44,100 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,100 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,100 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for dbf62160fc10af7e629bfbd8d5c5566b: 2023-07-15 09:11:44,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 09:11:44,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 09:11:44,500 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:44,500 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 27fafc2afba386b6163b7d51b46551e5, disabling compactions & flushes 2023-07-15 09:11:44,500 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,500 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,500 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. after waiting 0 ms 2023-07-15 09:11:44,500 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,500 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,500 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 27fafc2afba386b6163b7d51b46551e5: 2023-07-15 09:11:44,503 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:11:44,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412304504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412304504"}]},"ts":"1689412304504"} 2023-07-15 09:11:44,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412304504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412304504"}]},"ts":"1689412304504"} 2023-07-15 09:11:44,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:11:44,508 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:11:44,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412304508"}]},"ts":"1689412304508"} 2023-07-15 09:11:44,511 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 09:11:44,514 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:11:44,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:11:44,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:11:44,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:11:44,515 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:11:44,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, ASSIGN}] 2023-07-15 09:11:44,518 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, ASSIGN 2023-07-15 09:11:44,518 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, ASSIGN 2023-07-15 09:11:44,521 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36901,1689412260724; forceNewPlan=false, retain=false 2023-07-15 09:11:44,521 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44901,1689412260598; forceNewPlan=false, retain=false 2023-07-15 09:11:44,671 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:11:44,675 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=27fafc2afba386b6163b7d51b46551e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:44,675 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=dbf62160fc10af7e629bfbd8d5c5566b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:44,675 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412304674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412304674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412304674"}]},"ts":"1689412304674"} 2023-07-15 09:11:44,675 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412304674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412304674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412304674"}]},"ts":"1689412304674"} 2023-07-15 09:11:44,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 27fafc2afba386b6163b7d51b46551e5, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:11:44,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 09:11:44,678 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure dbf62160fc10af7e629bfbd8d5c5566b, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:11:44,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27fafc2afba386b6163b7d51b46551e5, NAME => 'testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 09:11:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. service=AccessControlService 2023-07-15 09:11:44,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbf62160fc10af7e629bfbd8d5c5566b, NAME => 'testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 09:11:44,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. service=AccessControlService 2023-07-15 09:11:44,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:11:44,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:11:44,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,843 INFO [StoreOpener-27fafc2afba386b6163b7d51b46551e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,845 INFO [StoreOpener-dbf62160fc10af7e629bfbd8d5c5566b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,845 DEBUG [StoreOpener-27fafc2afba386b6163b7d51b46551e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf 2023-07-15 09:11:44,845 DEBUG [StoreOpener-27fafc2afba386b6163b7d51b46551e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf 2023-07-15 09:11:44,846 INFO [StoreOpener-27fafc2afba386b6163b7d51b46551e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27fafc2afba386b6163b7d51b46551e5 columnFamilyName cf 2023-07-15 09:11:44,846 DEBUG [StoreOpener-dbf62160fc10af7e629bfbd8d5c5566b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf 2023-07-15 09:11:44,846 DEBUG [StoreOpener-dbf62160fc10af7e629bfbd8d5c5566b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf 2023-07-15 09:11:44,846 INFO [StoreOpener-27fafc2afba386b6163b7d51b46551e5-1] regionserver.HStore(310): Store=27fafc2afba386b6163b7d51b46551e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:44,847 INFO [StoreOpener-dbf62160fc10af7e629bfbd8d5c5566b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbf62160fc10af7e629bfbd8d5c5566b columnFamilyName cf 2023-07-15 09:11:44,847 INFO [StoreOpener-dbf62160fc10af7e629bfbd8d5c5566b-1] regionserver.HStore(310): Store=dbf62160fc10af7e629bfbd8d5c5566b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:11:44,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:11:44,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:11:44,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:44,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:11:44,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27fafc2afba386b6163b7d51b46551e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70522974, jitterRate=0.05087420344352722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:44,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27fafc2afba386b6163b7d51b46551e5: 2023-07-15 09:11:44,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbf62160fc10af7e629bfbd8d5c5566b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74277847, jitterRate=0.10682617127895355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:11:44,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbf62160fc10af7e629bfbd8d5c5566b: 2023-07-15 09:11:44,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5., pid=45, masterSystemTime=1689412304831 2023-07-15 09:11:44,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b., pid=46, masterSystemTime=1689412304833 2023-07-15 09:11:44,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:44,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=27fafc2afba386b6163b7d51b46551e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:44,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412304858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412304858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412304858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412304858"}]},"ts":"1689412304858"} 2023-07-15 09:11:44,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:44,859 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=dbf62160fc10af7e629bfbd8d5c5566b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:44,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412304859"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412304859"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412304859"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412304859"}]},"ts":"1689412304859"} 2023-07-15 09:11:44,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-15 09:11:44,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 27fafc2afba386b6163b7d51b46551e5, server=jenkins-hbase4.apache.org,36901,1689412260724 in 184 msec 2023-07-15 09:11:44,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-15 09:11:44,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure dbf62160fc10af7e629bfbd8d5c5566b, server=jenkins-hbase4.apache.org,44901,1689412260598 in 184 msec 2023-07-15 09:11:44,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, ASSIGN in 349 msec 2023-07-15 09:11:44,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-15 09:11:44,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, ASSIGN in 350 msec 2023-07-15 09:11:44,869 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:11:44,869 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412304869"}]},"ts":"1689412304869"} 2023-07-15 09:11:44,870 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 09:11:44,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:11:44,874 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 09:11:44,876 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 09:11:44,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:44,878 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:44,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:44,878 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:11:44,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:44,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:44,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:44,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 09:11:44,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 810 msec 2023-07-15 09:11:45,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 09:11:45,180 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 09:11:45,180 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-15 09:11:45,180 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:45,182 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 09:11:45,184 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-15 09:11:45,184 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:45,185 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-15 09:11:45,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 09:11:45,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412305188 (current time:1689412305188). 2023-07-15 09:11:45,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:11:45,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x09b99d8c to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:45,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a7e5b1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:45,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:45,203 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:45,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09b99d8c to 127.0.0.1:64993 2023-07-15 09:11:45,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:45,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x4369d9c7 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:45,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f979db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:45,219 DEBUG [hconnection-0x3ee76cb8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:45,222 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:45,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:45,227 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:45,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4369d9c7 to 127.0.0.1:64993 2023-07-15 09:11:45,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:45,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 09:11:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:11:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 09:11:45,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 09:11:45,233 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 09:11:45,234 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689412905234 2023-07-15 09:11:45,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 09:11:45,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 09:11:45,235 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:11:45,235 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:11:45,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 09:11:45,237 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 09:11:45,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-15 09:11:45,242 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 09:11:45,245 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689412905245 2023-07-15 09:11:45,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,260 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 09:11:45,260 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,261 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 09:11:45,262 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 09:11:45,262 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,262 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,263 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,263 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,264 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,263 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,264 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,264 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,265 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 09:11:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,266 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 09:11:45,266 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 09:11:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 09:11:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 09:11:45,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 09:11:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 09:11:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 09:11:45,268 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 09:11:45,269 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,269 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 09:11:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 09:11:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 09:11:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 09:11:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 09:11:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 09:11:45,274 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,275 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,275 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,275 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,275 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,276 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:45,275 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,276 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,276 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:45,276 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,276 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eef84d1[Count = 1] remaining members to acquire global barrier 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 09:11:45,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eef84d1[Count = 0] remaining members to acquire global barrier 2023-07-15 09:11:45,280 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 09:11:45,280 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 09:11:45,281 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 09:11:45,281 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,281 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 09:11:45,282 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:45,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:45,282 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,282 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:11:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 09:11:45,282 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. started... 2023-07-15 09:11:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:11:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:45,282 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:45,282 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:45,283 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. started... 2023-07-15 09:11:45,283 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27fafc2afba386b6163b7d51b46551e5: 2023-07-15 09:11:45,284 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbf62160fc10af7e629bfbd8d5c5566b: 2023-07-15 09:11:45,284 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,284 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,285 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:45,285 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:45,285 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:11:45,285 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:11:45,290 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 09:11:45,290 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,290 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 09:11:45,299 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. completed. 2023-07-15 09:11:45,299 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:45,299 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. completed. 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:11:45,299 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:45,299 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:45,300 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,300 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 09:11:45,300 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:11:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 09:11:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,301 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,301 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 09:11:45,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 09:11:45,303 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 09:11:45,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:11:45,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 09:11:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:11:45,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 09:11:45,310 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 09:11:45,310 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:11:45,310 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:11:45,310 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,310 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:11:45,312 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,312 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,312 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,313 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,313 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,313 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,314 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,317 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,317 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,318 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,321 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,321 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,321 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,321 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,321 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,322 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,322 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,323 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,323 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,324 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,324 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,324 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,335 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:45,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 09:11:45,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:45,337 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:11:45,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 09:11:45,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,373 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 09:11:45,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689412305234Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689412305322 (+88 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689412305322Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689412305327 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689412305334 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689412305372 (+38 ms) 2023-07-15 09:11:45,381 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 09:11:45,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 146 msec 2023-07-15 09:11:45,537 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:45,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 09:11:45,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:11:45,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44901] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:11:45,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36901] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:11:45,553 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 09:11:45,553 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:45,555 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:11:45,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 09:11:45,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412305566 (current time:1689412305566). 2023-07-15 09:11:45,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:11:45,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x45c67aa2 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:45,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36ef74c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:45,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:45,591 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:45,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45c67aa2 to 127.0.0.1:64993 2023-07-15 09:11:45,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:45,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x0a48e10b to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:11:45,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cad998a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:11:45,701 DEBUG [hconnection-0x31a98394-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:45,704 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:45,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:11:45,711 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:11:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a48e10b to 127.0.0.1:64993 2023-07-15 09:11:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:11:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 09:11:45,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:11:45,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 09:11:45,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 09:11:45,716 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 09:11:45,716 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689412905716 2023-07-15 09:11:45,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 09:11:45,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 09:11:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:11:45,717 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:11:45,718 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 09:11:45,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 09:11:45,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 4 msec 2023-07-15 09:11:45,720 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 09:11:45,721 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689412905721 2023-07-15 09:11:45,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 09:11:45,734 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 09:11:45,734 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,736 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 09:11:45,736 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 09:11:45,736 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,736 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,737 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,738 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,738 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,737 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,738 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,738 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,738 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,738 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:11:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 09:11:45,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 09:11:45,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 09:11:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 09:11:45,740 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 09:11:45,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 09:11:45,740 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,740 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 09:11:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,741 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 09:11:45,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 09:11:45,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 09:11:45,742 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:11:45,743 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 09:11:45,743 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 09:11:45,743 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 09:11:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,745 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,745 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,745 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:45,745 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,747 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,747 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:11:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d597db8[Count = 1] remaining members to acquire global barrier 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 09:11:45,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d597db8[Count = 0] remaining members to acquire global barrier 2023-07-15 09:11:45,751 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 09:11:45,751 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 09:11:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 09:11:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 09:11:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 09:11:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:11:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:45,754 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:45,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:11:45,753 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:45,754 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. started... 2023-07-15 09:11:45,754 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dbf62160fc10af7e629bfbd8d5c5566b 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 09:11:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 09:11:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 09:11:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:11:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:11:45,760 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:45,760 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. started... 2023-07-15 09:11:45,760 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 27fafc2afba386b6163b7d51b46551e5 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 09:11:45,785 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/.tmp/cf/e2e570cdce2c4325a146e8893e91ff78 2023-07-15 09:11:45,789 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/.tmp/cf/57f034143ac3441481045be48ff8bde4 2023-07-15 09:11:45,793 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/.tmp/cf/e2e570cdce2c4325a146e8893e91ff78 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf/e2e570cdce2c4325a146e8893e91ff78 2023-07-15 09:11:45,799 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/.tmp/cf/57f034143ac3441481045be48ff8bde4 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf/57f034143ac3441481045be48ff8bde4 2023-07-15 09:11:45,801 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf/e2e570cdce2c4325a146e8893e91ff78, entries=3, sequenceid=6, filesize=5.0 K 2023-07-15 09:11:45,802 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for dbf62160fc10af7e629bfbd8d5c5566b in 48ms, sequenceid=6, compaction requested=false 2023-07-15 09:11:45,804 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbf62160fc10af7e629bfbd8d5c5566b: 2023-07-15 09:11:45,804 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 09:11:45,804 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:45,804 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf/e2e570cdce2c4325a146e8893e91ff78] hfiles 2023-07-15 09:11:45,804 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf/e2e570cdce2c4325a146e8893e91ff78 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 09:11:45,806 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf/57f034143ac3441481045be48ff8bde4, entries=47, sequenceid=6, filesize=8 K 2023-07-15 09:11:45,807 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 27fafc2afba386b6163b7d51b46551e5 in 47ms, sequenceid=6, compaction requested=false 2023-07-15 09:11:45,807 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27fafc2afba386b6163b7d51b46551e5: 2023-07-15 09:11:45,808 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 09:11:45,808 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:11:45,808 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf/57f034143ac3441481045be48ff8bde4] hfiles 2023-07-15 09:11:45,808 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf/57f034143ac3441481045be48ff8bde4 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 09:11:45,814 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. completed. 2023-07-15 09:11:45,814 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 09:11:45,814 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:11:45,816 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 09:11:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,818 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 09:11:45,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 09:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:11:45,819 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,820 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. completed. 2023-07-15 09:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,820 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:11:45,820 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:11:45,820 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:11:45,820 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,820 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 09:11:45,820 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,823 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 09:11:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,823 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,823 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,824 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 09:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 09:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:11:45,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 09:11:45,831 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 09:11:45,831 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:11:45,831 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:11:45,831 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 09:11:45,831 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,833 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:11:45,835 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,836 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:11:45,836 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:11:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 09:11:45,839 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,840 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,840 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,852 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,852 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,852 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:11:45,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:11:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,852 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,852 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,852 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:11:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:11:45,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:11:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:11:45,859 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,859 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,859 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,859 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 09:11:45,859 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 09:11:45,859 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:11:45,859 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:11:45,860 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,861 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:11:45,861 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:11:45,861 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,861 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 09:11:45,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,914 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:45,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689412305716Consolidate snapshot: snaptb0-testConsecutiveExports at 1689412305859 (+143 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689412305859Writing data manifest for snaptb0-testConsecutiveExports at 1689412305864 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689412305879 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689412305914 (+35 ms) 2023-07-15 09:11:45,917 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 09:11:45,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 200 msec 2023-07-15 09:11:46,020 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:11:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 09:11:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:11:46,021 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021 2023-07-15 09:11:46,021 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:46,044 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:46,045 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4a4c6f89, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:46,045 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 09:11:46,052 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:46,065 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,065 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,065 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,066 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,066 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,066 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,067 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,134 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-8397289611250194201.jar 2023-07-15 09:11:46,135 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,135 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,135 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,136 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,136 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,136 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:46,137 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:11:46,137 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:11:46,137 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:11:46,138 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:11:46,138 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:11:46,138 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:11:46,139 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:11:46,139 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:11:46,139 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:11:46,140 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:11:46,140 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:46,141 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:46,142 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:46,142 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:46,637 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:11:46,639 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 09:11:46,642 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 09:11:47,828 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:11:47,829 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:11:47,831 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0002_000001 (auth:SIMPLE) 2023-07-15 09:11:48,549 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0003_000001 (auth:SIMPLE) 2023-07-15 09:11:49,344 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:11:52,801 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0003_000001 (auth:SIMPLE) 2023-07-15 09:11:55,037 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0003_000001 (auth:SIMPLE) 2023-07-15 09:11:57,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0003_000001 (auth:SIMPLE) 2023-07-15 09:11:58,813 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:11:58,814 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:11:58,822 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 09:11:58,822 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:11:58,823 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:11:58,823 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 09:11:58,824 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 09:11:58,824 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 09:11:58,824 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@57b3f6c1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 09:11:58,824 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 09:11:58,824 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 09:11:58,826 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:58,852 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:11:58,853 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@663f8cbd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:58,853 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 09:11:58,877 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 09:11:58,892 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,893 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,893 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,894 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,895 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,895 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,895 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,980 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-4264629722683396389.jar 2023-07-15 09:11:58,981 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,981 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,981 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,982 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,982 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,982 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:11:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:11:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:11:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:11:58,984 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:11:58,984 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:11:58,985 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:11:58,985 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:11:58,985 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:11:58,985 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:11:58,986 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:11:58,986 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:58,987 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:58,987 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:58,987 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:58,987 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:11:58,988 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:11:58,988 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:00,235 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:12:00,237 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 09:12:00,239 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 09:12:03,775 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:03,775 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:03,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0003_000001 (auth:SIMPLE) 2023-07-15 09:12:03,843 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0004_000001 (auth:SIMPLE) 2023-07-15 09:12:07,706 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0004_000001 (auth:SIMPLE) 2023-07-15 09:12:09,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0004_000001 (auth:SIMPLE) 2023-07-15 09:12:13,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0004_000001 (auth:SIMPLE) 2023-07-15 09:12:14,417 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:12:14,418 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:12:14,422 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 09:12:14,422 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:12:14,422 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:12:14,423 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 09:12:14,427 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 09:12:14,428 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 09:12:14,428 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@57b3f6c1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 09:12:14,428 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 09:12:14,428 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/local-export-1689412306021/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 09:12:14,442 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 09:12:14,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 09:12:14,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 09:12:14,454 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412334454"}]},"ts":"1689412334454"} 2023-07-15 09:12:14,456 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 09:12:14,458 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 09:12:14,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, UNASSIGN}] 2023-07-15 09:12:14,460 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, UNASSIGN 2023-07-15 09:12:14,462 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, UNASSIGN 2023-07-15 09:12:14,463 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=27fafc2afba386b6163b7d51b46551e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:14,463 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=dbf62160fc10af7e629bfbd8d5c5566b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:14,463 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412334463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412334463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412334463"}]},"ts":"1689412334463"} 2023-07-15 09:12:14,463 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412334463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412334463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412334463"}]},"ts":"1689412334463"} 2023-07-15 09:12:14,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 27fafc2afba386b6163b7d51b46551e5, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:14,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure dbf62160fc10af7e629bfbd8d5c5566b, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:12:14,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 09:12:14,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:12:14,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27fafc2afba386b6163b7d51b46551e5, disabling compactions & flushes 2023-07-15 09:12:14,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:12:14,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:12:14,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. after waiting 0 ms 2023-07-15 09:12:14,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:12:14,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:12:14,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbf62160fc10af7e629bfbd8d5c5566b, disabling compactions & flushes 2023-07-15 09:12:14,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:12:14,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:12:14,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. after waiting 0 ms 2023-07-15 09:12:14,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:12:14,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:12:14,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:12:14,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:14,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5. 2023-07-15 09:12:14,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27fafc2afba386b6163b7d51b46551e5: 2023-07-15 09:12:14,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:14,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b. 2023-07-15 09:12:14,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbf62160fc10af7e629bfbd8d5c5566b: 2023-07-15 09:12:14,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:12:14,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=27fafc2afba386b6163b7d51b46551e5, regionState=CLOSED 2023-07-15 09:12:14,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412334639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412334639"}]},"ts":"1689412334639"} 2023-07-15 09:12:14,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:12:14,640 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=dbf62160fc10af7e629bfbd8d5c5566b, regionState=CLOSED 2023-07-15 09:12:14,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689412334640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412334640"}]},"ts":"1689412334640"} 2023-07-15 09:12:14,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-15 09:12:14,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 27fafc2afba386b6163b7d51b46551e5, server=jenkins-hbase4.apache.org,36901,1689412260724 in 176 msec 2023-07-15 09:12:14,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-15 09:12:14,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure dbf62160fc10af7e629bfbd8d5c5566b, server=jenkins-hbase4.apache.org,44901,1689412260598 in 177 msec 2023-07-15 09:12:14,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=27fafc2afba386b6163b7d51b46551e5, UNASSIGN in 185 msec 2023-07-15 09:12:14,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-15 09:12:14,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbf62160fc10af7e629bfbd8d5c5566b, UNASSIGN in 186 msec 2023-07-15 09:12:14,648 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412334648"}]},"ts":"1689412334648"} 2023-07-15 09:12:14,650 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 09:12:14,652 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 09:12:14,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 210 msec 2023-07-15 09:12:14,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 09:12:14,755 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 09:12:14,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 09:12:14,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,759 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 09:12:14,760 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,763 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 09:12:14,767 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,767 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,767 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,767 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,767 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:12:14,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 09:12:14,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 09:12:14,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 09:12:14,768 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 09:12:14,767 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:14,769 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:14,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 09:12:14,771 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/recovered.edits] 2023-07-15 09:12:14,772 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/recovered.edits] 2023-07-15 09:12:14,776 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf/57f034143ac3441481045be48ff8bde4 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/cf/57f034143ac3441481045be48ff8bde4 2023-07-15 09:12:14,777 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf/e2e570cdce2c4325a146e8893e91ff78 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/cf/e2e570cdce2c4325a146e8893e91ff78 2023-07-15 09:12:14,781 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5/recovered.edits/9.seqid 2023-07-15 09:12:14,781 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b/recovered.edits/9.seqid 2023-07-15 09:12:14,782 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/27fafc2afba386b6163b7d51b46551e5 2023-07-15 09:12:14,782 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testConsecutiveExports/dbf62160fc10af7e629bfbd8d5c5566b 2023-07-15 09:12:14,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 09:12:14,785 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,787 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 09:12:14,795 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 09:12:14,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 09:12:14,796 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412334796"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:14,796 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412334796"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:14,798 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 09:12:14,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dbf62160fc10af7e629bfbd8d5c5566b, NAME => 'testtb-testConsecutiveExports,,1689412304068.dbf62160fc10af7e629bfbd8d5c5566b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 27fafc2afba386b6163b7d51b46551e5, NAME => 'testtb-testConsecutiveExports,1,1689412304068.27fafc2afba386b6163b7d51b46551e5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 09:12:14,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 09:12:14,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412334799"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:14,800 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 09:12:14,802 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 09:12:14,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-07-15 09:12:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 09:12:14,872 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 09:12:14,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 09:12:14,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 09:12:14,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 09:12:14,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 09:12:14,933 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=751 (was 768), OpenFileDescriptor=912 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 379) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=3661 (was 3274) - AvailableMemoryMB LEAK? - 2023-07-15 09:12:14,933 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-15 09:12:14,962 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=751, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=183, AvailableMemoryMB=3655 2023-07-15 09:12:14,962 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-15 09:12:14,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:12:14,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:14,972 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:12:14,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 09:12:14,973 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:12:14,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 09:12:14,976 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:14,976 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:14,977 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 empty. 2023-07-15 09:12:14,977 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 empty. 2023-07-15 09:12:14,977 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:14,977 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:14,977 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 09:12:14,993 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 09:12:14,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 72d06d559f50e4463986c9a1cb5c9373, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:14,995 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec7c1c9fff037c2f9fa54bc0453135b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:15,017 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:15,017 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 72d06d559f50e4463986c9a1cb5c9373, disabling compactions & flushes 2023-07-15 09:12:15,017 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. after waiting 0 ms 2023-07-15 09:12:15,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,018 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 72d06d559f50e4463986c9a1cb5c9373: 2023-07-15 09:12:15,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:15,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing ec7c1c9fff037c2f9fa54bc0453135b8, disabling compactions & flushes 2023-07-15 09:12:15,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. after waiting 0 ms 2023-07-15 09:12:15,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for ec7c1c9fff037c2f9fa54bc0453135b8: 2023-07-15 09:12:15,028 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:12:15,029 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412335029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412335029"}]},"ts":"1689412335029"} 2023-07-15 09:12:15,029 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412335029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412335029"}]},"ts":"1689412335029"} 2023-07-15 09:12:15,041 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:12:15,042 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:12:15,042 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412335042"}]},"ts":"1689412335042"} 2023-07-15 09:12:15,043 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 09:12:15,048 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:12:15,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:12:15,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:12:15,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:12:15,049 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:12:15,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, ASSIGN}] 2023-07-15 09:12:15,053 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, ASSIGN 2023-07-15 09:12:15,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, ASSIGN 2023-07-15 09:12:15,054 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44901,1689412260598; forceNewPlan=false, retain=false 2023-07-15 09:12:15,054 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36901,1689412260724; forceNewPlan=false, retain=false 2023-07-15 09:12:15,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 09:12:15,205 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:12:15,209 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ec7c1c9fff037c2f9fa54bc0453135b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,209 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412335208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412335208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412335208"}]},"ts":"1689412335208"} 2023-07-15 09:12:15,209 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=72d06d559f50e4463986c9a1cb5c9373, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,209 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412335208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412335208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412335208"}]},"ts":"1689412335208"} 2023-07-15 09:12:15,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure ec7c1c9fff037c2f9fa54bc0453135b8, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:15,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 72d06d559f50e4463986c9a1cb5c9373, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:12:15,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 09:12:15,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec7c1c9fff037c2f9fa54bc0453135b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 09:12:15,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. service=AccessControlService 2023-07-15 09:12:15,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:15,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:15,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72d06d559f50e4463986c9a1cb5c9373, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 09:12:15,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. service=AccessControlService 2023-07-15 09:12:15,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:15,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:15,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,411 INFO [StoreOpener-ec7c1c9fff037c2f9fa54bc0453135b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,412 INFO [StoreOpener-72d06d559f50e4463986c9a1cb5c9373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,415 DEBUG [StoreOpener-ec7c1c9fff037c2f9fa54bc0453135b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf 2023-07-15 09:12:15,415 DEBUG [StoreOpener-72d06d559f50e4463986c9a1cb5c9373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf 2023-07-15 09:12:15,416 DEBUG [StoreOpener-72d06d559f50e4463986c9a1cb5c9373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf 2023-07-15 09:12:15,415 DEBUG [StoreOpener-ec7c1c9fff037c2f9fa54bc0453135b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf 2023-07-15 09:12:15,417 INFO [StoreOpener-ec7c1c9fff037c2f9fa54bc0453135b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec7c1c9fff037c2f9fa54bc0453135b8 columnFamilyName cf 2023-07-15 09:12:15,418 INFO [StoreOpener-ec7c1c9fff037c2f9fa54bc0453135b8-1] regionserver.HStore(310): Store=ec7c1c9fff037c2f9fa54bc0453135b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:15,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:15,431 INFO [StoreOpener-72d06d559f50e4463986c9a1cb5c9373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72d06d559f50e4463986c9a1cb5c9373 columnFamilyName cf 2023-07-15 09:12:15,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:15,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec7c1c9fff037c2f9fa54bc0453135b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65134512, jitterRate=-0.029420137405395508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:15,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec7c1c9fff037c2f9fa54bc0453135b8: 2023-07-15 09:12:15,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8., pid=60, masterSystemTime=1689412335364 2023-07-15 09:12:15,440 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=ec7c1c9fff037c2f9fa54bc0453135b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,440 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412335440"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412335440"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412335440"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412335440"}]},"ts":"1689412335440"} 2023-07-15 09:12:15,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,445 INFO [StoreOpener-72d06d559f50e4463986c9a1cb5c9373-1] regionserver.HStore(310): Store=72d06d559f50e4463986c9a1cb5c9373/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:15,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 09:12:15,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure ec7c1c9fff037c2f9fa54bc0453135b8, server=jenkins-hbase4.apache.org,36901,1689412260724 in 230 msec 2023-07-15 09:12:15,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, ASSIGN in 396 msec 2023-07-15 09:12:15,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:15,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:15,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 72d06d559f50e4463986c9a1cb5c9373; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65071306, jitterRate=-0.030361980199813843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:15,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 72d06d559f50e4463986c9a1cb5c9373: 2023-07-15 09:12:15,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373., pid=61, masterSystemTime=1689412335366 2023-07-15 09:12:15,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,462 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=72d06d559f50e4463986c9a1cb5c9373, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,463 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412335462"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412335462"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412335462"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412335462"}]},"ts":"1689412335462"} 2023-07-15 09:12:15,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-15 09:12:15,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 72d06d559f50e4463986c9a1cb5c9373, server=jenkins-hbase4.apache.org,44901,1689412260598 in 251 msec 2023-07-15 09:12:15,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 09:12:15,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, ASSIGN in 417 msec 2023-07-15 09:12:15,471 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:12:15,471 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412335471"}]},"ts":"1689412335471"} 2023-07-15 09:12:15,473 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 09:12:15,476 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:12:15,476 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 09:12:15,478 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 09:12:15,480 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:15,480 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:15,480 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:15,480 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:15,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:15,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:15,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:15,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:15,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 519 msec 2023-07-15 09:12:15,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 09:12:15,578 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 09:12:15,578 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-15 09:12:15,578 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:15,582 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-15 09:12:15,583 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:15,583 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-15 09:12:15,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 09:12:15,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412335587 (current time:1689412335587). 2023-07-15 09:12:15,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:15,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x142d6dca to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:15,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7edb07c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:15,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:15,607 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:15,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x142d6dca to 127.0.0.1:64993 2023-07-15 09:12:15,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:15,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x238aec70 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:15,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c3686f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:15,715 DEBUG [hconnection-0x7af54f93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:15,716 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:15,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:15,723 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:15,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x238aec70 to 127.0.0.1:64993 2023-07-15 09:12:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 09:12:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:15,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 09:12:15,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 09:12:15,729 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 09:12:15,730 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689412935730 2023-07-15 09:12:15,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 09:12:15,732 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:15,732 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:15,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 09:12:15,733 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 09:12:15,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-15 09:12:15,736 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 09:12:15,736 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689412935736 2023-07-15 09:12:15,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,752 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 09:12:15,752 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:15,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 09:12:15,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 09:12:15,754 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,754 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,755 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:15,755 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:15,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:15,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:15,755 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:15,755 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:15,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:15,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,757 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 09:12:15,757 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 09:12:15,758 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:15,757 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:15,759 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 09:12:15,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,759 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 09:12:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 09:12:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 09:12:15,762 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 09:12:15,762 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 09:12:15,760 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 09:12:15,762 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 09:12:15,762 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 09:12:15,762 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 09:12:15,763 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,764 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:15,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:15,764 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,764 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:15,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 09:12:15,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2b7d91[Count = 1] remaining members to acquire global barrier 2023-07-15 09:12:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:15,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:15,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 09:12:15,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2b7d91[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:15,771 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 09:12:15,771 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,772 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 09:12:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 09:12:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 09:12:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 09:12:15,773 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:15,774 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,774 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:15,774 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,774 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:15,774 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. started... 2023-07-15 09:12:15,774 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. started... 2023-07-15 09:12:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:15,776 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 72d06d559f50e4463986c9a1cb5c9373: 2023-07-15 09:12:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:15,778 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,778 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:15,778 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:12:15,782 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec7c1c9fff037c2f9fa54bc0453135b8: 2023-07-15 09:12:15,782 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,783 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:15,783 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:12:15,795 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 09:12:15,795 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:15,795 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 09:12:15,802 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. completed. 2023-07-15 09:12:15,803 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:15,803 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:15,803 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:15,803 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,803 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 09:12:15,803 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:15,805 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 09:12:15,805 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,805 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:15,805 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 09:12:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:15,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:15,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:12:15,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 09:12:15,832 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:15,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 09:12:15,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:15,834 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:15,839 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. completed. 2023-07-15 09:12:15,839 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:15,839 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:15,839 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:15,839 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,839 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 09:12:15,839 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:15,841 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,841 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 09:12:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:15,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:15,841 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:15,841 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 09:12:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:15,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:12:15,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 09:12:15,847 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 09:12:15,847 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:15,847 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:15,847 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,847 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:15,850 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:15,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:15,851 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:15,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,855 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:15,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:15,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,855 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,856 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,856 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,858 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,859 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,859 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:15,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:15,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:15,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:15,864 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:15,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:15,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:15,863 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:15,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,866 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:15,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:15,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:15,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:15,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,034 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:16,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 09:12:16,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:16,035 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:12:16,336 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:16,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 09:12:16,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:16,337 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 09:12:16,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 09:12:16,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,358 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689412335730Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689412335864 (+134 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689412335864Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689412335876 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689412335895 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689412336358 (+463 ms) 2023-07-15 09:12:16,361 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 09:12:16,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 630 msec 2023-07-15 09:12:16,837 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:16,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 09:12:16,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:16,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44901] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:12:16,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36901] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:12:16,849 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,849 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:16,849 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:16,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 09:12:16,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412336858 (current time:1689412336858). 2023-07-15 09:12:16,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x2f4ab7b3 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:16,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76a68d1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:16,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:16,869 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:16,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f4ab7b3 to 127.0.0.1:64993 2023-07-15 09:12:16,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:16,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x574718cc to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:16,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dcacab8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:16,879 DEBUG [hconnection-0x6fc65c46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:16,881 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:16,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:16,885 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:16,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x574718cc to 127.0.0.1:64993 2023-07-15 09:12:16,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:16,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 09:12:16,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:16,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 09:12:16,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 09:12:16,890 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 09:12:16,890 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689412936890 2023-07-15 09:12:16,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 09:12:16,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,892 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:16,892 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:16,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 09:12:16,893 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 09:12:16,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-15 09:12:16,895 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 09:12:16,895 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689412936895 2023-07-15 09:12:16,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,905 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 09:12:16,905 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:16,906 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 09:12:16,906 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 09:12:16,906 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,906 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,907 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:16,907 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:16,907 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,907 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:16,908 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,908 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,908 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,908 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 09:12:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 09:12:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 09:12:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 09:12:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 09:12:16,909 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 09:12:16,912 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 09:12:16,912 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 09:12:16,912 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 09:12:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 09:12:16,912 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 09:12:16,912 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 09:12:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,916 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,916 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,916 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8dd33d[Count = 1] remaining members to acquire global barrier 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:16,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 09:12:16,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8dd33d[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:16,920 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 09:12:16,920 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,921 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,921 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,921 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 09:12:16,922 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:16,922 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:16,922 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:16,922 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. started... 2023-07-15 09:12:16,922 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,922 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 09:12:16,922 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. started... 2023-07-15 09:12:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:16,922 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec7c1c9fff037c2f9fa54bc0453135b8 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 09:12:16,923 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 72d06d559f50e4463986c9a1cb5c9373 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 09:12:16,924 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 09:12:16,924 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:16,924 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 09:12:16,939 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/.tmp/cf/c9564a7037814674bd7d7dccb3c55713 2023-07-15 09:12:16,941 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/.tmp/cf/ad5241642e8b4ce9b205501be7723017 2023-07-15 09:12:16,947 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/.tmp/cf/c9564a7037814674bd7d7dccb3c55713 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf/c9564a7037814674bd7d7dccb3c55713 2023-07-15 09:12:16,947 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/.tmp/cf/ad5241642e8b4ce9b205501be7723017 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf/ad5241642e8b4ce9b205501be7723017 2023-07-15 09:12:16,952 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf/c9564a7037814674bd7d7dccb3c55713, entries=3, sequenceid=6, filesize=5.0 K 2023-07-15 09:12:16,952 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf/ad5241642e8b4ce9b205501be7723017, entries=47, sequenceid=6, filesize=8 K 2023-07-15 09:12:16,953 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 72d06d559f50e4463986c9a1cb5c9373 in 30ms, sequenceid=6, compaction requested=false 2023-07-15 09:12:16,953 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 09:12:16,953 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 72d06d559f50e4463986c9a1cb5c9373: 2023-07-15 09:12:16,954 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,954 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:16,954 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf/c9564a7037814674bd7d7dccb3c55713] hfiles 2023-07-15 09:12:16,954 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf/c9564a7037814674bd7d7dccb3c55713 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,954 INFO [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ec7c1c9fff037c2f9fa54bc0453135b8 in 32ms, sequenceid=6, compaction requested=false 2023-07-15 09:12:16,956 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec7c1c9fff037c2f9fa54bc0453135b8: 2023-07-15 09:12:16,956 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,956 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:16,956 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf/ad5241642e8b4ce9b205501be7723017] hfiles 2023-07-15 09:12:16,956 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf/ad5241642e8b4ce9b205501be7723017 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,965 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. completed. 2023-07-15 09:12:16,965 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:16,965 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:16,966 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. completed. 2023-07-15 09:12:16,966 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 09:12:16,966 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:16,967 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,967 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 09:12:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:16,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:16,967 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:16,967 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 09:12:16,970 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 09:12:16,970 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:16,970 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:16,971 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 09:12:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:16,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:12:16,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 09:12:16,979 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 09:12:16,979 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:16,979 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:16,979 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,979 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:16,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,988 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:16,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,988 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,987 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:16,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:16,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:16,988 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,990 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,991 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:16,991 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,992 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:16,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 09:12:16,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:16,993 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:16,993 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:16,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:16,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:16,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:16,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:16,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,994 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:16,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:16,994 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:16,995 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:16,995 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,995 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:16,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:16,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:16,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:16,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:17,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:17,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 09:12:17,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:17,041 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:17,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689412336891Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689412336994 (+103 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689412336995 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689412337000 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689412337008 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689412337040 (+32 ms) 2023-07-15 09:12:17,044 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 09:12:17,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 152 msec 2023-07-15 09:12:17,193 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:17,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 09:12:17,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:17,223 DEBUG [Listener at jenkins-hbase4.apache.org/39797] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 09:12:17,229 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 09:12:17,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36901] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 09:12:17,231 DEBUG [Listener at jenkins-hbase4.apache.org/39797] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 09:12:17,235 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 09:12:17,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40347] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 09:12:17,236 DEBUG [Listener at jenkins-hbase4.apache.org/39797] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 09:12:17,238 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 09:12:17,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44901] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 09:12:17,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:12:17,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:17,244 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:12:17,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 09:12:17,244 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:12:17,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 09:12:17,247 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,247 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,247 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad empty. 2023-07-15 09:12:17,247 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 empty. 2023-07-15 09:12:17,248 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,248 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,248 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 09:12:17,260 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 09:12:17,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => ff57e8e097aa8d95ee4c103a41fa87ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:17,262 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f9d91a74183774958490041fbe5f804, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing ff57e8e097aa8d95ee4c103a41fa87ad, disabling compactions & flushes 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 2f9d91a74183774958490041fbe5f804, disabling compactions & flushes 2023-07-15 09:12:17,274 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,274 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. after waiting 0 ms 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. after waiting 0 ms 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,274 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for ff57e8e097aa8d95ee4c103a41fa87ad: 2023-07-15 09:12:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 2f9d91a74183774958490041fbe5f804: 2023-07-15 09:12:17,277 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:12:17,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412337278"}]},"ts":"1689412337278"} 2023-07-15 09:12:17,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412337278"}]},"ts":"1689412337278"} 2023-07-15 09:12:17,280 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:12:17,282 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:12:17,282 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412337282"}]},"ts":"1689412337282"} 2023-07-15 09:12:17,284 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 09:12:17,286 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:12:17,287 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:12:17,287 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:12:17,287 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:12:17,287 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:12:17,287 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, ASSIGN}] 2023-07-15 09:12:17,290 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, ASSIGN 2023-07-15 09:12:17,290 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, ASSIGN 2023-07-15 09:12:17,291 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40347,1689412260661; forceNewPlan=false, retain=false 2023-07-15 09:12:17,291 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36901,1689412260724; forceNewPlan=false, retain=false 2023-07-15 09:12:17,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 09:12:17,441 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:12:17,444 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2f9d91a74183774958490041fbe5f804, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:17,444 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ff57e8e097aa8d95ee4c103a41fa87ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:17,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337444"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412337444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412337444"}]},"ts":"1689412337444"} 2023-07-15 09:12:17,444 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337444"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412337444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412337444"}]},"ts":"1689412337444"} 2023-07-15 09:12:17,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 2f9d91a74183774958490041fbe5f804, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:12:17,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure ff57e8e097aa8d95ee4c103a41fa87ad, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:17,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 09:12:17,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f9d91a74183774958490041fbe5f804, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 09:12:17,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff57e8e097aa8d95ee4c103a41fa87ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. service=AccessControlService 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. service=AccessControlService 2023-07-15 09:12:17,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:17,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,608 INFO [StoreOpener-ff57e8e097aa8d95ee4c103a41fa87ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,608 INFO [StoreOpener-2f9d91a74183774958490041fbe5f804-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,609 DEBUG [StoreOpener-ff57e8e097aa8d95ee4c103a41fa87ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf 2023-07-15 09:12:17,609 DEBUG [StoreOpener-2f9d91a74183774958490041fbe5f804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf 2023-07-15 09:12:17,609 DEBUG [StoreOpener-ff57e8e097aa8d95ee4c103a41fa87ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf 2023-07-15 09:12:17,609 DEBUG [StoreOpener-2f9d91a74183774958490041fbe5f804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf 2023-07-15 09:12:17,610 INFO [StoreOpener-ff57e8e097aa8d95ee4c103a41fa87ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff57e8e097aa8d95ee4c103a41fa87ad columnFamilyName cf 2023-07-15 09:12:17,610 INFO [StoreOpener-2f9d91a74183774958490041fbe5f804-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f9d91a74183774958490041fbe5f804 columnFamilyName cf 2023-07-15 09:12:17,610 INFO [StoreOpener-ff57e8e097aa8d95ee4c103a41fa87ad-1] regionserver.HStore(310): Store=ff57e8e097aa8d95ee4c103a41fa87ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:17,611 INFO [StoreOpener-2f9d91a74183774958490041fbe5f804-1] regionserver.HStore(310): Store=2f9d91a74183774958490041fbe5f804/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:17,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:17,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:17,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f9d91a74183774958490041fbe5f804; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65813151, jitterRate=-0.019307628273963928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f9d91a74183774958490041fbe5f804: 2023-07-15 09:12:17,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff57e8e097aa8d95ee4c103a41fa87ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71383906, jitterRate=0.06370308995246887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff57e8e097aa8d95ee4c103a41fa87ad: 2023-07-15 09:12:17,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804., pid=69, masterSystemTime=1689412337597 2023-07-15 09:12:17,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad., pid=70, masterSystemTime=1689412337598 2023-07-15 09:12:17,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:17,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ff57e8e097aa8d95ee4c103a41fa87ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:17,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,621 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337621"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412337621"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412337621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412337621"}]},"ts":"1689412337621"} 2023-07-15 09:12:17,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:17,622 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2f9d91a74183774958490041fbe5f804, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:17,622 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337621"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412337621"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412337621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412337621"}]},"ts":"1689412337621"} 2023-07-15 09:12:17,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-15 09:12:17,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure ff57e8e097aa8d95ee4c103a41fa87ad, server=jenkins-hbase4.apache.org,36901,1689412260724 in 176 msec 2023-07-15 09:12:17,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-15 09:12:17,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 2f9d91a74183774958490041fbe5f804, server=jenkins-hbase4.apache.org,40347,1689412260661 in 177 msec 2023-07-15 09:12:17,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, ASSIGN in 338 msec 2023-07-15 09:12:17,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-15 09:12:17,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, ASSIGN in 339 msec 2023-07-15 09:12:17,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:12:17,629 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412337629"}]},"ts":"1689412337629"} 2023-07-15 09:12:17,630 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 09:12:17,634 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:12:17,634 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 09:12:17,636 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 09:12:17,637 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:17,637 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:17,637 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:17,637 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:17,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:17,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 398 msec 2023-07-15 09:12:17,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 09:12:17,848 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 09:12:17,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions ff57e8e097aa8d95ee4c103a41fa87ad, 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:17,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ff57e8e097aa8d95ee4c103a41fa87ad, 2f9d91a74183774958490041fbe5f804], force=true 2023-07-15 09:12:17,888 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ff57e8e097aa8d95ee4c103a41fa87ad, 2f9d91a74183774958490041fbe5f804], force=true 2023-07-15 09:12:17,888 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ff57e8e097aa8d95ee4c103a41fa87ad, 2f9d91a74183774958490041fbe5f804], force=true 2023-07-15 09:12:17,888 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ff57e8e097aa8d95ee4c103a41fa87ad, 2f9d91a74183774958490041fbe5f804], force=true 2023-07-15 09:12:17,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 09:12:17,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, UNASSIGN}] 2023-07-15 09:12:17,914 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, UNASSIGN 2023-07-15 09:12:17,914 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, UNASSIGN 2023-07-15 09:12:17,915 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ff57e8e097aa8d95ee4c103a41fa87ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:17,915 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2f9d91a74183774958490041fbe5f804, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:17,915 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412337914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412337914"}]},"ts":"1689412337914"} 2023-07-15 09:12:17,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412337915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412337915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412337915"}]},"ts":"1689412337915"} 2023-07-15 09:12:17,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure ff57e8e097aa8d95ee4c103a41fa87ad, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:17,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 2f9d91a74183774958490041fbe5f804, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:12:17,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 09:12:18,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:18,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff57e8e097aa8d95ee4c103a41fa87ad, disabling compactions & flushes 2023-07-15 09:12:18,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:18,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:18,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. after waiting 0 ms 2023-07-15 09:12:18,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:18,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ff57e8e097aa8d95ee4c103a41fa87ad 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 09:12:18,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f9d91a74183774958490041fbe5f804, disabling compactions & flushes 2023-07-15 09:12:18,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. after waiting 0 ms 2023-07-15 09:12:18,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:18,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2f9d91a74183774958490041fbe5f804 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 09:12:18,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/.tmp/cf/53688d04b93a4abdaac7a326b06bbc4b 2023-07-15 09:12:18,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/.tmp/cf/6a8a0d2a59454b838e85d9965ddffdaa 2023-07-15 09:12:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/.tmp/cf/6a8a0d2a59454b838e85d9965ddffdaa as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf/6a8a0d2a59454b838e85d9965ddffdaa 2023-07-15 09:12:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/.tmp/cf/53688d04b93a4abdaac7a326b06bbc4b as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf/53688d04b93a4abdaac7a326b06bbc4b 2023-07-15 09:12:18,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf/53688d04b93a4abdaac7a326b06bbc4b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 09:12:18,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf/6a8a0d2a59454b838e85d9965ddffdaa, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 09:12:18,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ff57e8e097aa8d95ee4c103a41fa87ad in 34ms, sequenceid=5, compaction requested=false 2023-07-15 09:12:18,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 09:12:18,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2f9d91a74183774958490041fbe5f804 in 37ms, sequenceid=5, compaction requested=false 2023-07-15 09:12:18,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 09:12:18,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 09:12:18,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:18,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804. 2023-07-15 09:12:18,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f9d91a74183774958490041fbe5f804: 2023-07-15 09:12:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:18,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad. 2023-07-15 09:12:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff57e8e097aa8d95ee4c103a41fa87ad: 2023-07-15 09:12:18,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:18,123 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2f9d91a74183774958490041fbe5f804, regionState=CLOSED 2023-07-15 09:12:18,123 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412338123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412338123"}]},"ts":"1689412338123"} 2023-07-15 09:12:18,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:18,124 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ff57e8e097aa8d95ee4c103a41fa87ad, regionState=CLOSED 2023-07-15 09:12:18,124 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689412338124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412338124"}]},"ts":"1689412338124"} 2023-07-15 09:12:18,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 09:12:18,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 2f9d91a74183774958490041fbe5f804, server=jenkins-hbase4.apache.org,40347,1689412260661 in 208 msec 2023-07-15 09:12:18,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 09:12:18,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2f9d91a74183774958490041fbe5f804, UNASSIGN in 217 msec 2023-07-15 09:12:18,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure ff57e8e097aa8d95ee4c103a41fa87ad, server=jenkins-hbase4.apache.org,36901,1689412260724 in 211 msec 2023-07-15 09:12:18,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-15 09:12:18,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ff57e8e097aa8d95ee4c103a41fa87ad, UNASSIGN in 221 msec 2023-07-15 09:12:18,192 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 09:12:18,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 09:12:18,194 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337240.ff57e8e097aa8d95ee4c103a41fa87ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:18,194 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689412337240.2f9d91a74183774958490041fbe5f804.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:18,194 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:18,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, ASSIGN}] 2023-07-15 09:12:18,249 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, ASSIGN 2023-07-15 09:12:18,249 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,36901,1689412260724; forceNewPlan=false, retain=false 2023-07-15 09:12:18,400 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 09:12:18,402 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0b31fc9c3d66508471b9c934c9c604d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:18,402 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689412338401"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412338401"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412338401"}]},"ts":"1689412338401"} 2023-07-15 09:12:18,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 0b31fc9c3d66508471b9c934c9c604d2, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:18,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 09:12:18,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:18,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b31fc9c3d66508471b9c934c9c604d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.', STARTKEY => '', ENDKEY => ''} 2023-07-15 09:12:18,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. service=AccessControlService 2023-07-15 09:12:18,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:18,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:18,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/.regioninfo 2023-07-15 09:12:18,576 INFO [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,578 DEBUG [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf 2023-07-15 09:12:18,578 DEBUG [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf 2023-07-15 09:12:18,578 INFO [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b31fc9c3d66508471b9c934c9c604d2 columnFamilyName cf 2023-07-15 09:12:18,611 DEBUG [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] regionserver.HStore(539): loaded hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/53688d04b93a4abdaac7a326b06bbc4b.2f9d91a74183774958490041fbe5f804->hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf/53688d04b93a4abdaac7a326b06bbc4b-top 2023-07-15 09:12:18,616 DEBUG [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] regionserver.HStore(539): loaded hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/6a8a0d2a59454b838e85d9965ddffdaa.ff57e8e097aa8d95ee4c103a41fa87ad->hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf/6a8a0d2a59454b838e85d9965ddffdaa-top 2023-07-15 09:12:18,616 INFO [StoreOpener-0b31fc9c3d66508471b9c934c9c604d2-1] regionserver.HStore(310): Store=0b31fc9c3d66508471b9c934c9c604d2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:18,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:18,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b31fc9c3d66508471b9c934c9c604d2; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66223557, jitterRate=-0.013192102313041687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:18,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b31fc9c3d66508471b9c934c9c604d2: 2023-07-15 09:12:18,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2., pid=77, masterSystemTime=1689412338555 2023-07-15 09:12:18,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.,because compaction is disabled. 2023-07-15 09:12:18,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:18,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:18,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0b31fc9c3d66508471b9c934c9c604d2, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:18,627 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689412338627"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412338627"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412338627"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412338627"}]},"ts":"1689412338627"} 2023-07-15 09:12:18,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 09:12:18,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 0b31fc9c3d66508471b9c934c9c604d2, server=jenkins-hbase4.apache.org,36901,1689412260724 in 225 msec 2023-07-15 09:12:18,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 09:12:18,654 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, ASSIGN in 404 msec 2023-07-15 09:12:18,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ff57e8e097aa8d95ee4c103a41fa87ad, 2f9d91a74183774958490041fbe5f804], force=true in 776 msec 2023-07-15 09:12:18,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 09:12:18,996 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 09:12:18,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 09:12:18,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412338997 (current time:1689412338997). 2023-07-15 09:12:18,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:18,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x38d3ec6c to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:19,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65ef91d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:19,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:19,013 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:19,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38d3ec6c to 127.0.0.1:64993 2023-07-15 09:12:19,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:19,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x71425997 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:19,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56557b5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:19,028 DEBUG [hconnection-0x4f2d1146-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:19,032 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:19,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:19,038 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:19,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71425997 to 127.0.0.1:64993 2023-07-15 09:12:19,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:19,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 09:12:19,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:19,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 09:12:19,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 09:12:19,050 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 09:12:19,051 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689412939051 2023-07-15 09:12:19,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 09:12:19,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,058 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:19,058 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:19,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 09:12:19,059 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 09:12:19,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-15 09:12:19,062 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 09:12:19,062 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689412939062 2023-07-15 09:12:19,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,122 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 09:12:19,122 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:19,123 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 09:12:19,123 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 09:12:19,124 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,124 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,125 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:19,125 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:19,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:19,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:19,125 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:19,125 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:19,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:19,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:19,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:19,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,126 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,126 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:19,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 09:12:19,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 09:12:19,127 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:19,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,128 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 09:12:19,129 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:19,129 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 09:12:19,129 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 09:12:19,129 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 09:12:19,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 09:12:19,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 09:12:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,132 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:19,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,155 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 09:12:19,156 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:19,157 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 09:12:19,157 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 09:12:19,157 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 09:12:19,159 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 09:12:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 09:12:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 09:12:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 09:12:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:19,160 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,161 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:19,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:19,161 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:19,162 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:19,162 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,163 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:19,163 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,163 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:19,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:19,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 09:12:19,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38e615b1[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:19,165 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 09:12:19,165 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,166 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,166 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,166 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:19,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 09:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 09:12:19,167 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:19,169 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 09:12:19,169 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:19,169 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 09:12:19,175 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,175 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:19,176 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 09:12:19,176 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:19,176 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 09:12:19,178 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:19,178 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:19,193 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:19,193 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. started... 2023-07-15 09:12:19,195 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0b31fc9c3d66508471b9c934c9c604d2: 2023-07-15 09:12:19,195 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,195 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:19,195 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/53688d04b93a4abdaac7a326b06bbc4b.2f9d91a74183774958490041fbe5f804->hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf/53688d04b93a4abdaac7a326b06bbc4b-top, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/6a8a0d2a59454b838e85d9965ddffdaa.ff57e8e097aa8d95ee4c103a41fa87ad->hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf/6a8a0d2a59454b838e85d9965ddffdaa-top] hfiles 2023-07-15 09:12:19,195 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/53688d04b93a4abdaac7a326b06bbc4b.2f9d91a74183774958490041fbe5f804 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,196 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/6a8a0d2a59454b838e85d9965ddffdaa.ff57e8e097aa8d95ee4c103a41fa87ad for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,265 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. completed. 2023-07-15 09:12:19,265 DEBUG [rs(jenkins-hbase4.apache.org,36901,1689412260724)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:19,265 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,266 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 09:12:19,266 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:19,272 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,272 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 09:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:19,272 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:19,273 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 09:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,36901,1689412260724': 2023-07-15 09:12:19,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 09:12:19,280 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 09:12:19,280 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:19,280 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:19,280 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,280 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:19,284 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,284 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:19,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,285 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,285 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:19,285 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:19,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:19,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:19,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0004_000001 (auth:SIMPLE) 2023-07-15 09:12:19,288 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,288 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:19,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,290 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,290 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,298 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,300 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,300 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,300 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:19,305 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,305 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:19,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:19,305 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:19,306 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:19,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:19,306 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,306 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,306 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:19,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:19,307 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,307 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:19,307 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:19,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:19,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:19,307 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,307 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,361 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:19,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 09:12:19,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:19,366 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:12:19,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 09:12:19,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,429 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689412339051Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689412339305 (+254 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689412339305Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689412339332 (+27 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689412339349 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689412339428 (+79 ms) 2023-07-15 09:12:19,432 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 09:12:19,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 377 msec 2023-07-15 09:12:19,666 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:19,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 09:12:19,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:19,668 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668 2023-07-15 09:12:19,668 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38909, tgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668, rawTgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:12:19,696 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:12:19,696 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-876745107_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,696 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 09:12:19,723 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:19,798 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,799 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,877 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-1701991885857313073.jar 2023-07-15 09:12:19,877 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,878 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,878 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,878 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,879 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,879 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:19,879 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:12:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:12:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:12:19,881 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:12:19,881 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:12:19,882 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:12:19,882 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:12:19,882 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:12:19,883 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:12:19,883 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:12:19,884 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:19,884 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:19,884 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:19,884 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:19,885 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:19,885 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:19,885 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:20,277 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:12:21,120 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:12:21,122 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 09:12:21,126 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 09:12:21,228 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:21,228 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:21,294 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0005_000001 (auth:SIMPLE) 2023-07-15 09:12:27,308 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0005_000001 (auth:SIMPLE) 2023-07-15 09:12:29,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0005_000001 (auth:SIMPLE) 2023-07-15 09:12:34,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0005_000001 (auth:SIMPLE) 2023-07-15 09:12:36,409 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:12:36,412 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:12:36,444 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,444 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:12:36,445 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:12:36,445 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,446 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 09:12:36,446 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 09:12:36,446 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,447 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 09:12:36,447 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412339668/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 09:12:36,455 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 09:12:36,462 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412356462"}]},"ts":"1689412356462"} 2023-07-15 09:12:36,464 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 09:12:36,466 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 09:12:36,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, UNASSIGN}] 2023-07-15 09:12:36,470 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, UNASSIGN 2023-07-15 09:12:36,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0b31fc9c3d66508471b9c934c9c604d2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:36,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689412356471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412356471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412356471"}]},"ts":"1689412356471"} 2023-07-15 09:12:36,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 0b31fc9c3d66508471b9c934c9c604d2, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:36,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 09:12:36,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b31fc9c3d66508471b9c934c9c604d2, disabling compactions & flushes 2023-07-15 09:12:36,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. after waiting 0 ms 2023-07-15 09:12:36,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:36,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 09:12:36,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:36,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2. 2023-07-15 09:12:36,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b31fc9c3d66508471b9c934c9c604d2: 2023-07-15 09:12:36,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:36,669 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0b31fc9c3d66508471b9c934c9c604d2, regionState=CLOSED 2023-07-15 09:12:36,669 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689412356669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412356669"}]},"ts":"1689412356669"} 2023-07-15 09:12:36,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 09:12:36,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 0b31fc9c3d66508471b9c934c9c604d2, server=jenkins-hbase4.apache.org,36901,1689412260724 in 200 msec 2023-07-15 09:12:36,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 09:12:36,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0b31fc9c3d66508471b9c934c9c604d2, UNASSIGN in 210 msec 2023-07-15 09:12:36,680 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412356680"}]},"ts":"1689412356680"} 2023-07-15 09:12:36,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 09:12:36,683 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 09:12:36,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 228 msec 2023-07-15 09:12:36,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 09:12:36,766 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 09:12:36,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,772 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,773 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,775 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 09:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 09:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 09:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:36,782 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:36,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:36,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:36,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 09:12:36,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:36,788 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:36,795 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:36,798 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:36,799 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:36,800 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/recovered.edits] 2023-07-15 09:12:36,801 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/recovered.edits] 2023-07-15 09:12:36,809 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/recovered.edits] 2023-07-15 09:12:36,814 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf/53688d04b93a4abdaac7a326b06bbc4b to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/cf/53688d04b93a4abdaac7a326b06bbc4b 2023-07-15 09:12:36,814 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/53688d04b93a4abdaac7a326b06bbc4b.2f9d91a74183774958490041fbe5f804 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/53688d04b93a4abdaac7a326b06bbc4b.2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:36,817 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/6a8a0d2a59454b838e85d9965ddffdaa.ff57e8e097aa8d95ee4c103a41fa87ad to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/cf/6a8a0d2a59454b838e85d9965ddffdaa.ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:36,820 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/recovered.edits/8.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804/recovered.edits/8.seqid 2023-07-15 09:12:36,820 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2f9d91a74183774958490041fbe5f804 2023-07-15 09:12:36,827 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf/6a8a0d2a59454b838e85d9965ddffdaa to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/cf/6a8a0d2a59454b838e85d9965ddffdaa 2023-07-15 09:12:36,829 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/recovered.edits/12.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2/recovered.edits/12.seqid 2023-07-15 09:12:36,830 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0b31fc9c3d66508471b9c934c9c604d2 2023-07-15 09:12:36,831 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/recovered.edits/8.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad/recovered.edits/8.seqid 2023-07-15 09:12:36,832 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ff57e8e097aa8d95ee4c103a41fa87ad 2023-07-15 09:12:36,832 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 09:12:36,834 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,838 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 09:12:36,841 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 09:12:36,842 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,842 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 09:12:36,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412356842"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:36,845 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 09:12:36,845 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0b31fc9c3d66508471b9c934c9c604d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689412337241.0b31fc9c3d66508471b9c934c9c604d2.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 09:12:36,845 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 09:12:36,845 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412356845"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:36,847 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 09:12:36,849 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:36,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 82 msec 2023-07-15 09:12:36,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 09:12:36,889 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 09:12:36,889 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:36,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:36,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:36,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 09:12:36,896 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412356896"}]},"ts":"1689412356896"} 2023-07-15 09:12:36,899 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 09:12:36,902 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 09:12:36,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, UNASSIGN}] 2023-07-15 09:12:36,904 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, UNASSIGN 2023-07-15 09:12:36,906 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, UNASSIGN 2023-07-15 09:12:36,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ec7c1c9fff037c2f9fa54bc0453135b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:36,907 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412356907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412356907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412356907"}]},"ts":"1689412356907"} 2023-07-15 09:12:36,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=72d06d559f50e4463986c9a1cb5c9373, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:36,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412356908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412356908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412356908"}]},"ts":"1689412356908"} 2023-07-15 09:12:36,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure ec7c1c9fff037c2f9fa54bc0453135b8, server=jenkins-hbase4.apache.org,36901,1689412260724}] 2023-07-15 09:12:36,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 72d06d559f50e4463986c9a1cb5c9373, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:12:36,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 09:12:37,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:37,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec7c1c9fff037c2f9fa54bc0453135b8, disabling compactions & flushes 2023-07-15 09:12:37,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:37,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:37,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. after waiting 0 ms 2023-07-15 09:12:37,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:37,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:37,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 72d06d559f50e4463986c9a1cb5c9373, disabling compactions & flushes 2023-07-15 09:12:37,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:37,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:37,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. after waiting 0 ms 2023-07-15 09:12:37,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:12:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:12:37,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:37,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:37,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373. 2023-07-15 09:12:37,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8. 2023-07-15 09:12:37,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 72d06d559f50e4463986c9a1cb5c9373: 2023-07-15 09:12:37,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec7c1c9fff037c2f9fa54bc0453135b8: 2023-07-15 09:12:37,087 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:37,089 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=ec7c1c9fff037c2f9fa54bc0453135b8, regionState=CLOSED 2023-07-15 09:12:37,089 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412357089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412357089"}]},"ts":"1689412357089"} 2023-07-15 09:12:37,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:37,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=72d06d559f50e4463986c9a1cb5c9373, regionState=CLOSED 2023-07-15 09:12:37,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689412357092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412357092"}]},"ts":"1689412357092"} 2023-07-15 09:12:37,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-15 09:12:37,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure ec7c1c9fff037c2f9fa54bc0453135b8, server=jenkins-hbase4.apache.org,36901,1689412260724 in 184 msec 2023-07-15 09:12:37,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-15 09:12:37,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 72d06d559f50e4463986c9a1cb5c9373, server=jenkins-hbase4.apache.org,44901,1689412260598 in 184 msec 2023-07-15 09:12:37,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec7c1c9fff037c2f9fa54bc0453135b8, UNASSIGN in 193 msec 2023-07-15 09:12:37,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-15 09:12:37,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=72d06d559f50e4463986c9a1cb5c9373, UNASSIGN in 195 msec 2023-07-15 09:12:37,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412357101"}]},"ts":"1689412357101"} 2023-07-15 09:12:37,103 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 09:12:37,105 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 09:12:37,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 215 msec 2023-07-15 09:12:37,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 09:12:37,200 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 09:12:37,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,205 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,207 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,208 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,212 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:37,212 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:37,214 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,214 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,214 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,214 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 09:12:37,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 09:12:37,216 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 09:12:37,218 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,218 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/recovered.edits] 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,218 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,218 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/recovered.edits] 2023-07-15 09:12:37,219 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 09:12:37,224 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf/c9564a7037814674bd7d7dccb3c55713 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/cf/c9564a7037814674bd7d7dccb3c55713 2023-07-15 09:12:37,224 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf/ad5241642e8b4ce9b205501be7723017 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/cf/ad5241642e8b4ce9b205501be7723017 2023-07-15 09:12:37,228 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373/recovered.edits/9.seqid 2023-07-15 09:12:37,228 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8/recovered.edits/9.seqid 2023-07-15 09:12:37,228 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/72d06d559f50e4463986c9a1cb5c9373 2023-07-15 09:12:37,228 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec7c1c9fff037c2f9fa54bc0453135b8 2023-07-15 09:12:37,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 09:12:37,231 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,233 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 09:12:37,236 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 09:12:37,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 09:12:37,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412357237"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:37,237 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412357237"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:37,239 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 09:12:37,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 72d06d559f50e4463986c9a1cb5c9373, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689412334964.72d06d559f50e4463986c9a1cb5c9373.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ec7c1c9fff037c2f9fa54bc0453135b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689412334964.ec7c1c9fff037c2f9fa54bc0453135b8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 09:12:37,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 09:12:37,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412357240"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:37,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 09:12:37,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 43 msec 2023-07-15 09:12:37,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 09:12:37,324 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 09:12:37,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 09:12:37,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 09:12:37,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 09:12:37,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 09:12:37,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 09:12:37,383 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 751) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6f656688-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902115643_1 at /127.0.0.1:45528 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_902115643_1 at /127.0.0.1:56086 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:54604 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:42289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:45560 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=480 (was 384) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2411 (was 3655) 2023-07-15 09:12:37,384 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 09:12:37,408 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=480, ProcessCount=187, AvailableMemoryMB=2399 2023-07-15 09:12:37,408 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 09:12:37,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:12:37,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:37,414 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:12:37,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 09:12:37,415 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:12:37,418 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,418 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,418 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 empty. 2023-07-15 09:12:37,419 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb empty. 2023-07-15 09:12:37,419 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,419 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,419 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 09:12:37,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 09:12:37,440 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 09:12:37,449 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2cc32aa5ea059c5d87232f66ecf10620, NAME => 'testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:37,449 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4c420c5f6cd9972ac9e30ca8109c65fb, NAME => 'testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:37,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:37,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2cc32aa5ea059c5d87232f66ecf10620, disabling compactions & flushes 2023-07-15 09:12:37,470 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. after waiting 0 ms 2023-07-15 09:12:37,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,470 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2cc32aa5ea059c5d87232f66ecf10620: 2023-07-15 09:12:37,474 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:37,474 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4c420c5f6cd9972ac9e30ca8109c65fb, disabling compactions & flushes 2023-07-15 09:12:37,474 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,474 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,474 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. after waiting 0 ms 2023-07-15 09:12:37,474 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,474 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,474 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4c420c5f6cd9972ac9e30ca8109c65fb: 2023-07-15 09:12:37,477 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:12:37,478 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412357478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412357478"}]},"ts":"1689412357478"} 2023-07-15 09:12:37,478 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412357478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412357478"}]},"ts":"1689412357478"} 2023-07-15 09:12:37,487 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:12:37,488 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:12:37,489 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412357488"}]},"ts":"1689412357488"} 2023-07-15 09:12:37,490 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 09:12:37,495 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:12:37,496 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:12:37,496 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:12:37,496 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:12:37,496 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:12:37,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, ASSIGN}] 2023-07-15 09:12:37,500 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, ASSIGN 2023-07-15 09:12:37,500 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, ASSIGN 2023-07-15 09:12:37,501 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44901,1689412260598; forceNewPlan=false, retain=false 2023-07-15 09:12:37,501 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40347,1689412260661; forceNewPlan=false, retain=false 2023-07-15 09:12:37,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 09:12:37,651 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:12:37,655 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2cc32aa5ea059c5d87232f66ecf10620, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:37,656 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412357655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412357655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412357655"}]},"ts":"1689412357655"} 2023-07-15 09:12:37,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4c420c5f6cd9972ac9e30ca8109c65fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:37,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412357655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412357655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412357655"}]},"ts":"1689412357655"} 2023-07-15 09:12:37,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 2cc32aa5ea059c5d87232f66ecf10620, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:12:37,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 4c420c5f6cd9972ac9e30ca8109c65fb, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:12:37,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 09:12:37,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2cc32aa5ea059c5d87232f66ecf10620, NAME => 'testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 09:12:37,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. service=AccessControlService 2023-07-15 09:12:37,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:37,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:37,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c420c5f6cd9972ac9e30ca8109c65fb, NAME => 'testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 09:12:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. service=AccessControlService 2023-07-15 09:12:37,820 INFO [StoreOpener-2cc32aa5ea059c5d87232f66ecf10620-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,821 DEBUG [StoreOpener-2cc32aa5ea059c5d87232f66ecf10620-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf 2023-07-15 09:12:37,821 DEBUG [StoreOpener-2cc32aa5ea059c5d87232f66ecf10620-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf 2023-07-15 09:12:37,821 INFO [StoreOpener-4c420c5f6cd9972ac9e30ca8109c65fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,822 INFO [StoreOpener-2cc32aa5ea059c5d87232f66ecf10620-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2cc32aa5ea059c5d87232f66ecf10620 columnFamilyName cf 2023-07-15 09:12:37,822 INFO [StoreOpener-2cc32aa5ea059c5d87232f66ecf10620-1] regionserver.HStore(310): Store=2cc32aa5ea059c5d87232f66ecf10620/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,826 DEBUG [StoreOpener-4c420c5f6cd9972ac9e30ca8109c65fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf 2023-07-15 09:12:37,827 DEBUG [StoreOpener-4c420c5f6cd9972ac9e30ca8109c65fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf 2023-07-15 09:12:37,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:37,827 INFO [StoreOpener-4c420c5f6cd9972ac9e30ca8109c65fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c420c5f6cd9972ac9e30ca8109c65fb columnFamilyName cf 2023-07-15 09:12:37,828 INFO [StoreOpener-4c420c5f6cd9972ac9e30ca8109c65fb-1] regionserver.HStore(310): Store=4c420c5f6cd9972ac9e30ca8109c65fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:37,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:37,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2cc32aa5ea059c5d87232f66ecf10620; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75147120, jitterRate=0.11977934837341309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:37,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2cc32aa5ea059c5d87232f66ecf10620: 2023-07-15 09:12:37,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620., pid=93, masterSystemTime=1689412357812 2023-07-15 09:12:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:37,833 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2cc32aa5ea059c5d87232f66ecf10620, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:37,833 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412357832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412357832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412357832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412357832"}]},"ts":"1689412357832"} 2023-07-15 09:12:37,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:37,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:37,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-15 09:12:37,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c420c5f6cd9972ac9e30ca8109c65fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68860663, jitterRate=0.02610383927822113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:37,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c420c5f6cd9972ac9e30ca8109c65fb: 2023-07-15 09:12:37,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 2cc32aa5ea059c5d87232f66ecf10620, server=jenkins-hbase4.apache.org,40347,1689412260661 in 174 msec 2023-07-15 09:12:37,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, ASSIGN in 340 msec 2023-07-15 09:12:37,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb., pid=94, masterSystemTime=1689412357813 2023-07-15 09:12:37,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:37,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4c420c5f6cd9972ac9e30ca8109c65fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:37,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412357840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412357840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412357840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412357840"}]},"ts":"1689412357840"} 2023-07-15 09:12:37,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-15 09:12:37,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 4c420c5f6cd9972ac9e30ca8109c65fb, server=jenkins-hbase4.apache.org,44901,1689412260598 in 181 msec 2023-07-15 09:12:37,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-15 09:12:37,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, ASSIGN in 347 msec 2023-07-15 09:12:37,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:12:37,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412357846"}]},"ts":"1689412357846"} 2023-07-15 09:12:37,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 09:12:37,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:12:37,850 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 09:12:37,851 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 09:12:37,853 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,853 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,853 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,853 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:37,854 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:37,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:37,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:37,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:37,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 443 msec 2023-07-15 09:12:38,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 09:12:38,029 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 09:12:38,029 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 09:12:38,030 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:38,033 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 09:12:38,033 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:38,033 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-15 09:12:38,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:12:38,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412358036 (current time:1689412358036). 2023-07-15 09:12:38,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:38,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x1245f265 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:38,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d35c047, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:38,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:38,057 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:38,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1245f265 to 127.0.0.1:64993 2023-07-15 09:12:38,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:38,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x1350bd06 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:38,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ebbb3d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:38,065 DEBUG [hconnection-0x7d5f79bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:38,067 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:38,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:38,071 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1350bd06 to 127.0.0.1:64993 2023-07-15 09:12:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 09:12:38,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:38,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:12:38,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:12:38,083 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:12:38,084 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689412958084 2023-07-15 09:12:38,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:12:38,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 09:12:38,085 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:38,086 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:38,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 09:12:38,096 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:12:38,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 22 msec 2023-07-15 09:12:38,100 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 09:12:38,101 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689412958101 2023-07-15 09:12:38,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,132 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 09:12:38,132 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,134 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 09:12:38,134 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 09:12:38,135 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,135 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,145 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,146 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,146 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,145 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,146 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,146 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 09:12:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 09:12:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 09:12:38,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 09:12:38,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 09:12:38,150 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,151 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 09:12:38,151 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 09:12:38,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 09:12:38,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,155 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,158 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 09:12:38,158 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 09:12:38,158 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 09:12:38,158 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 09:12:38,158 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 09:12:38,158 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 09:12:38,159 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,159 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,160 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:38,160 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,162 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,162 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 09:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e740ba8[Count = 1] remaining members to acquire global barrier 2023-07-15 09:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 09:12:38,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e740ba8[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:38,168 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 09:12:38,168 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,170 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,170 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,170 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:12:38,171 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,171 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,171 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:38,170 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,173 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:12:38,173 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 09:12:38,173 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:38,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,173 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:12:38,175 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 09:12:38,175 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,175 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 09:12:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:38,181 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:38,183 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:38,183 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. started... 2023-07-15 09:12:38,186 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:38,186 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c420c5f6cd9972ac9e30ca8109c65fb: 2023-07-15 09:12:38,186 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:38,186 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:38,186 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:38,186 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. started... 2023-07-15 09:12:38,187 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,187 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:38,187 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:12:38,188 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cc32aa5ea059c5d87232f66ecf10620: 2023-07-15 09:12:38,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:12:38,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:38,189 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,189 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:38,189 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:12:38,189 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:38,211 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. completed. 2023-07-15 09:12:38,211 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:38,211 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 09:12:38,212 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:38,213 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,214 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 09:12:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,214 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,214 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 09:12:38,216 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. completed. 2023-07-15 09:12:38,216 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 09:12:38,216 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:38,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,217 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,217 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 09:12:38,217 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,217 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 09:12:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:12:38,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 09:12:38,224 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 09:12:38,224 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:38,224 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:38,224 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,224 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:38,231 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,231 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,231 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,231 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,231 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,232 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,232 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,232 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,233 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,233 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,235 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,235 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,236 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,238 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,238 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,238 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,238 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,239 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,239 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,238 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,238 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,239 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,240 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,240 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,240 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,241 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,241 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,241 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,241 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,241 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,241 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 09:12:38,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,284 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689412358084Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689412358240 (+156 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689412358241 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689412358244 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689412358254 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689412358284 (+30 ms) 2023-07-15 09:12:38,288 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 09:12:38,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 203 msec 2023-07-15 09:12:38,389 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:12:38,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:38,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40347] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:12:38,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44901] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:12:38,407 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 09:12:38,407 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:38,408 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:38,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:12:38,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412358418 (current time:1689412358418). 2023-07-15 09:12:38,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:38,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x7c51f02a to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:38,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ac5ccba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:38,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:38,431 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:38,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c51f02a to 127.0.0.1:64993 2023-07-15 09:12:38,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:38,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x1db99b24 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:38,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e9af819, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:38,447 DEBUG [hconnection-0x3a6e496c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:38,448 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:38,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:38,459 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:38,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1db99b24 to 127.0.0.1:64993 2023-07-15 09:12:38,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:38,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 09:12:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:12:38,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:12:38,464 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:12:38,465 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689412958465 2023-07-15 09:12:38,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 09:12:38,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 09:12:38,466 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:38,466 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:38,467 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 09:12:38,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 09:12:38,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 09:12:38,469 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 09:12:38,470 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689412958470 2023-07-15 09:12:38,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,483 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 09:12:38,483 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,484 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 09:12:38,484 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 09:12:38,485 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,485 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,486 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,486 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,486 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,486 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,487 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,487 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,487 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 09:12:38,487 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 09:12:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,488 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 09:12:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 09:12:38,488 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 09:12:38,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 09:12:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 09:12:38,493 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 09:12:38,493 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 09:12:38,493 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 09:12:38,493 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 09:12:38,495 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,495 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,501 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,501 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,501 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,502 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:38,501 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,502 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,502 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,502 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,502 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef32a02[Count = 1] remaining members to acquire global barrier 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 09:12:38,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef32a02[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:38,507 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 09:12:38,507 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:12:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 09:12:38,511 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:38,511 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:38,511 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,512 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:38,511 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. started... 2023-07-15 09:12:38,512 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. started... 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:38,511 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:38,512 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2cc32aa5ea059c5d87232f66ecf10620 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 09:12:38,512 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4c420c5f6cd9972ac9e30ca8109c65fb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 09:12:38,513 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 09:12:38,513 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,513 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 09:12:38,546 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/.tmp/cf/d0b94c51a24c46f189430500676bc041 2023-07-15 09:12:38,551 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/.tmp/cf/5a9702466ab54ee183aa39583601ada7 2023-07-15 09:12:38,553 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/.tmp/cf/d0b94c51a24c46f189430500676bc041 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf/d0b94c51a24c46f189430500676bc041 2023-07-15 09:12:38,556 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/.tmp/cf/5a9702466ab54ee183aa39583601ada7 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf/5a9702466ab54ee183aa39583601ada7 2023-07-15 09:12:38,558 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf/d0b94c51a24c46f189430500676bc041, entries=3, sequenceid=6, filesize=5.0 K 2023-07-15 09:12:38,559 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2cc32aa5ea059c5d87232f66ecf10620 in 47ms, sequenceid=6, compaction requested=false 2023-07-15 09:12:38,559 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 09:12:38,560 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cc32aa5ea059c5d87232f66ecf10620: 2023-07-15 09:12:38,560 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,560 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:38,560 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf/d0b94c51a24c46f189430500676bc041] hfiles 2023-07-15 09:12:38,561 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf/d0b94c51a24c46f189430500676bc041 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,562 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf/5a9702466ab54ee183aa39583601ada7, entries=47, sequenceid=6, filesize=8.0 K 2023-07-15 09:12:38,563 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 4c420c5f6cd9972ac9e30ca8109c65fb in 51ms, sequenceid=6, compaction requested=false 2023-07-15 09:12:38,565 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c420c5f6cd9972ac9e30ca8109c65fb: 2023-07-15 09:12:38,565 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,565 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:38,565 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf/5a9702466ab54ee183aa39583601ada7] hfiles 2023-07-15 09:12:38,565 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf/5a9702466ab54ee183aa39583601ada7 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,567 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:38,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:12:38,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:38,569 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:38,579 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. completed. 2023-07-15 09:12:38,579 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:38,579 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:38,579 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:38,579 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,579 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 09:12:38,580 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 09:12:38,582 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 09:12:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,587 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. completed. 2023-07-15 09:12:38,587 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 09:12:38,587 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,589 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:12:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 09:12:38,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 09:12:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,589 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 09:12:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:12:38,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 09:12:38,594 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 09:12:38,594 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:38,594 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:38,594 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,594 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:38,596 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:38,596 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,596 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,597 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:38,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,597 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,598 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,600 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:38,600 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,600 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,602 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,602 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,603 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:38,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:38,603 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:38,603 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,604 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,605 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:38,605 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:38,605 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,605 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:38,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:38,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:38,769 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:38,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:12:38,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:38,770 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:12:39,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:39,070 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:39,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:12:39,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:39,072 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 09:12:39,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 09:12:39,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:39,483 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:39,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689412358465Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689412358603 (+138 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689412358606 (+3 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689412358614 (+8 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689412359027 (+413 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689412359482 (+455 ms) 2023-07-15 09:12:39,490 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 09:12:39,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.0240 sec 2023-07-15 09:12:39,572 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:39,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 09:12:39,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:39,574 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574 2023-07-15 09:12:39,574 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38909, tgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574, rawTgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:12:39,611 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:12:39,611 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-533750114_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:39,611 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 09:12:39,621 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:39,699 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,699 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,700 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,701 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,701 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,701 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,702 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,794 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-4549729157667948690.jar 2023-07-15 09:12:39,795 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,795 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,796 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,796 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,797 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,797 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:39,798 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:12:39,799 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:12:39,799 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:12:39,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:12:39,800 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:12:39,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:12:39,801 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:12:39,802 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:12:39,802 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:12:39,803 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:12:39,807 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:39,807 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:39,808 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:39,808 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:39,808 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:39,809 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:39,809 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:40,757 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:12:40,760 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 09:12:41,125 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:41,125 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:41,128 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0005_000001 (auth:SIMPLE) 2023-07-15 09:12:41,871 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0006_000001 (auth:SIMPLE) 2023-07-15 09:12:42,331 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:12:47,982 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0006_000001 (auth:SIMPLE) 2023-07-15 09:12:51,226 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:12:51,231 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:12:51,241 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:51,241 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:12:51,241 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:12:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 09:12:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 09:12:51,242 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:51,243 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 09:12:51,243 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412359574/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 09:12:51,264 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 09:12:51,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412371270"}]},"ts":"1689412371270"} 2023-07-15 09:12:51,274 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 09:12:51,276 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 09:12:51,279 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, UNASSIGN}] 2023-07-15 09:12:51,282 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, UNASSIGN 2023-07-15 09:12:51,282 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, UNASSIGN 2023-07-15 09:12:51,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2cc32aa5ea059c5d87232f66ecf10620, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:51,283 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4c420c5f6cd9972ac9e30ca8109c65fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:51,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412371282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412371282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412371282"}]},"ts":"1689412371282"} 2023-07-15 09:12:51,283 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412371283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412371283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412371283"}]},"ts":"1689412371283"} 2023-07-15 09:12:51,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 2cc32aa5ea059c5d87232f66ecf10620, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:12:51,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 4c420c5f6cd9972ac9e30ca8109c65fb, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:12:51,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 09:12:51,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:51,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2cc32aa5ea059c5d87232f66ecf10620, disabling compactions & flushes 2023-07-15 09:12:51,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:51,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:51,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. after waiting 0 ms 2023-07-15 09:12:51,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:51,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:51,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c420c5f6cd9972ac9e30ca8109c65fb, disabling compactions & flushes 2023-07-15 09:12:51,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:51,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:51,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. after waiting 0 ms 2023-07-15 09:12:51,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:51,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:12:51,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:51,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620. 2023-07-15 09:12:51,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2cc32aa5ea059c5d87232f66ecf10620: 2023-07-15 09:12:51,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:51,461 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2cc32aa5ea059c5d87232f66ecf10620, regionState=CLOSED 2023-07-15 09:12:51,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:12:51,461 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412371461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412371461"}]},"ts":"1689412371461"} 2023-07-15 09:12:51,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-15 09:12:51,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 2cc32aa5ea059c5d87232f66ecf10620, server=jenkins-hbase4.apache.org,40347,1689412260661 in 182 msec 2023-07-15 09:12:51,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2cc32aa5ea059c5d87232f66ecf10620, UNASSIGN in 189 msec 2023-07-15 09:12:51,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:12:51,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb. 2023-07-15 09:12:51,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c420c5f6cd9972ac9e30ca8109c65fb: 2023-07-15 09:12:51,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:51,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4c420c5f6cd9972ac9e30ca8109c65fb, regionState=CLOSED 2023-07-15 09:12:51,479 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689412371479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412371479"}]},"ts":"1689412371479"} 2023-07-15 09:12:51,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-15 09:12:51,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 4c420c5f6cd9972ac9e30ca8109c65fb, server=jenkins-hbase4.apache.org,44901,1689412260598 in 196 msec 2023-07-15 09:12:51,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-15 09:12:51,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4c420c5f6cd9972ac9e30ca8109c65fb, UNASSIGN in 204 msec 2023-07-15 09:12:51,486 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412371486"}]},"ts":"1689412371486"} 2023-07-15 09:12:51,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 09:12:51,490 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 09:12:51,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 226 msec 2023-07-15 09:12:51,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 09:12:51,573 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 09:12:51,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,583 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,587 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,587 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,587 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,587 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 09:12:51,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 09:12:51,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 09:12:51,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 09:12:51,590 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,591 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:51,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 09:12:51,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:51,602 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:51,607 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/recovered.edits] 2023-07-15 09:12:51,607 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/recovered.edits] 2023-07-15 09:12:51,621 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf/d0b94c51a24c46f189430500676bc041 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/cf/d0b94c51a24c46f189430500676bc041 2023-07-15 09:12:51,621 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf/5a9702466ab54ee183aa39583601ada7 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/cf/5a9702466ab54ee183aa39583601ada7 2023-07-15 09:12:51,625 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620/recovered.edits/9.seqid 2023-07-15 09:12:51,626 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb/recovered.edits/9.seqid 2023-07-15 09:12:51,626 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/2cc32aa5ea059c5d87232f66ecf10620 2023-07-15 09:12:51,629 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testEmptyExportFileSystemState/4c420c5f6cd9972ac9e30ca8109c65fb 2023-07-15 09:12:51,629 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 09:12:51,631 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,657 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 09:12:51,664 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 09:12:51,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 09:12:51,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412371667"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:51,667 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412371667"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:51,672 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 09:12:51,672 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2cc32aa5ea059c5d87232f66ecf10620, NAME => 'testtb-testEmptyExportFileSystemState,,1689412357410.2cc32aa5ea059c5d87232f66ecf10620.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4c420c5f6cd9972ac9e30ca8109c65fb, NAME => 'testtb-testEmptyExportFileSystemState,1,1689412357410.4c420c5f6cd9972ac9e30ca8109c65fb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 09:12:51,672 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 09:12:51,672 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412371672"}]},"ts":"9223372036854775807"} 2023-07-15 09:12:51,674 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 09:12:51,678 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 09:12:51,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 104 msec 2023-07-15 09:12:51,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 09:12:51,696 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 09:12:51,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 09:12:51,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:51,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 09:12:51,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 09:12:51,757 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 763) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:42465 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:34355 from appattempt_1689412268481_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_354066677_1 at /127.0.0.1:60624 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4717 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:54030 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:59648 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:51528 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_354066677_1 at /127.0.0.1:49506 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 915), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=547 (was 480) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 187), AvailableMemoryMB=1779 (was 2399) 2023-07-15 09:12:51,757 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-15 09:12:51,785 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=547, ProcessCount=184, AvailableMemoryMB=1774 2023-07-15 09:12:51,785 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-15 09:12:51,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 09:12:51,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:51,793 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 09:12:51,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 09:12:51,794 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 09:12:51,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 09:12:51,797 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:51,797 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:51,797 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 empty. 2023-07-15 09:12:51,797 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 empty. 2023-07-15 09:12:51,798 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:51,798 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:51,798 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 09:12:51,818 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 09:12:51,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => bccb80aff875e46c55d8894e392af4a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:51,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => fd488bcf9f623f21a9b8114e95fa1722, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp 2023-07-15 09:12:51,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:51,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing bccb80aff875e46c55d8894e392af4a1, disabling compactions & flushes 2023-07-15 09:12:51,839 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:51,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:51,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. after waiting 0 ms 2023-07-15 09:12:51,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:51,839 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:51,839 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for bccb80aff875e46c55d8894e392af4a1: 2023-07-15 09:12:51,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:51,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing fd488bcf9f623f21a9b8114e95fa1722, disabling compactions & flushes 2023-07-15 09:12:51,842 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:51,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:51,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. after waiting 0 ms 2023-07-15 09:12:51,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:51,842 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:51,842 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for fd488bcf9f623f21a9b8114e95fa1722: 2023-07-15 09:12:51,845 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 09:12:51,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412371846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412371846"}]},"ts":"1689412371846"} 2023-07-15 09:12:51,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412371846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412371846"}]},"ts":"1689412371846"} 2023-07-15 09:12:51,849 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 09:12:51,849 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 09:12:51,850 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412371849"}]},"ts":"1689412371849"} 2023-07-15 09:12:51,853 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 09:12:51,857 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 09:12:51,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 09:12:51,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 09:12:51,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 09:12:51,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 09:12:51,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, ASSIGN}] 2023-07-15 09:12:51,862 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, ASSIGN 2023-07-15 09:12:51,862 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, ASSIGN 2023-07-15 09:12:51,863 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40347,1689412260661; forceNewPlan=false, retain=false 2023-07-15 09:12:51,863 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44901,1689412260598; forceNewPlan=false, retain=false 2023-07-15 09:12:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 09:12:52,013 INFO [jenkins-hbase4:41729] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 09:12:52,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fd488bcf9f623f21a9b8114e95fa1722, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,017 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bccb80aff875e46c55d8894e392af4a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,017 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412372017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412372017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412372017"}]},"ts":"1689412372017"} 2023-07-15 09:12:52,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412372017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412372017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412372017"}]},"ts":"1689412372017"} 2023-07-15 09:12:52,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure fd488bcf9f623f21a9b8114e95fa1722, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:12:52,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure bccb80aff875e46c55d8894e392af4a1, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:12:52,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 09:12:52,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:52,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd488bcf9f623f21a9b8114e95fa1722, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 09:12:52,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. service=AccessControlService 2023-07-15 09:12:52,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:52,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:52,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:52,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bccb80aff875e46c55d8894e392af4a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 09:12:52,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. service=AccessControlService 2023-07-15 09:12:52,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 09:12:52,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,177 INFO [StoreOpener-fd488bcf9f623f21a9b8114e95fa1722-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 09:12:52,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,179 INFO [StoreOpener-bccb80aff875e46c55d8894e392af4a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,180 DEBUG [StoreOpener-fd488bcf9f623f21a9b8114e95fa1722-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf 2023-07-15 09:12:52,180 DEBUG [StoreOpener-fd488bcf9f623f21a9b8114e95fa1722-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf 2023-07-15 09:12:52,180 INFO [StoreOpener-fd488bcf9f623f21a9b8114e95fa1722-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd488bcf9f623f21a9b8114e95fa1722 columnFamilyName cf 2023-07-15 09:12:52,181 INFO [StoreOpener-fd488bcf9f623f21a9b8114e95fa1722-1] regionserver.HStore(310): Store=fd488bcf9f623f21a9b8114e95fa1722/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:52,181 DEBUG [StoreOpener-bccb80aff875e46c55d8894e392af4a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf 2023-07-15 09:12:52,181 DEBUG [StoreOpener-bccb80aff875e46c55d8894e392af4a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf 2023-07-15 09:12:52,181 INFO [StoreOpener-bccb80aff875e46c55d8894e392af4a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bccb80aff875e46c55d8894e392af4a1 columnFamilyName cf 2023-07-15 09:12:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,182 INFO [StoreOpener-bccb80aff875e46c55d8894e392af4a1-1] regionserver.HStore(310): Store=bccb80aff875e46c55d8894e392af4a1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 09:12:52,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:12:52,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:12:52,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:52,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bccb80aff875e46c55d8894e392af4a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74553059, jitterRate=0.11092714965343475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:52,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bccb80aff875e46c55d8894e392af4a1: 2023-07-15 09:12:52,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1., pid=109, masterSystemTime=1689412372173 2023-07-15 09:12:52,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 09:12:52,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd488bcf9f623f21a9b8114e95fa1722; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65665167, jitterRate=-0.02151276171207428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 09:12:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd488bcf9f623f21a9b8114e95fa1722: 2023-07-15 09:12:52,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:52,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:52,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722., pid=108, masterSystemTime=1689412372171 2023-07-15 09:12:52,196 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bccb80aff875e46c55d8894e392af4a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412372195"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412372195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412372195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412372195"}]},"ts":"1689412372195"} 2023-07-15 09:12:52,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:52,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:52,197 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fd488bcf9f623f21a9b8114e95fa1722, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,197 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412372197"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689412372197"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689412372197"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689412372197"}]},"ts":"1689412372197"} 2023-07-15 09:12:52,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 09:12:52,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure bccb80aff875e46c55d8894e392af4a1, server=jenkins-hbase4.apache.org,40347,1689412260661 in 177 msec 2023-07-15 09:12:52,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, ASSIGN in 342 msec 2023-07-15 09:12:52,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 09:12:52,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure fd488bcf9f623f21a9b8114e95fa1722, server=jenkins-hbase4.apache.org,44901,1689412260598 in 180 msec 2023-07-15 09:12:52,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-15 09:12:52,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, ASSIGN in 343 msec 2023-07-15 09:12:52,204 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 09:12:52,204 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412372204"}]},"ts":"1689412372204"} 2023-07-15 09:12:52,205 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 09:12:52,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 09:12:52,208 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 09:12:52,209 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 09:12:52,211 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:52,211 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:52,211 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:52,211 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:12:52,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:52,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:52,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:52,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 09:12:52,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 428 msec 2023-07-15 09:12:52,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 09:12:52,400 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 09:12:52,400 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-15 09:12:52,401 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:52,405 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-15 09:12:52,406 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:52,406 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-15 09:12:52,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 09:12:52,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412372410 (current time:1689412372410). 2023-07-15 09:12:52,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:52,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x2c7d256c to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:52,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@541b407a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:52,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:52,464 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:52,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c7d256c to 127.0.0.1:64993 2023-07-15 09:12:52,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:52,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x2945a03c to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:52,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c56b63d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:52,474 DEBUG [hconnection-0x6240335d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:52,478 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:52,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:52,485 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2945a03c to 127.0.0.1:64993 2023-07-15 09:12:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:52,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 09:12:52,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:52,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 09:12:52,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 09:12:52,492 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 09:12:52,493 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689412972493 2023-07-15 09:12:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 09:12:52,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,494 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:52,494 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:52,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 09:12:52,495 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 09:12:52,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-15 09:12:52,498 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 09:12:52,498 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689412972498 2023-07-15 09:12:52,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,520 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 09:12:52,520 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:52,524 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 09:12:52,524 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 09:12:52,525 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,525 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,526 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:52,526 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:52,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:52,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:52,527 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,527 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:52,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,527 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,527 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,528 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,528 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 09:12:52,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,528 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 09:12:52,529 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 09:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 09:12:52,531 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 09:12:52,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,532 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 09:12:52,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,532 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 09:12:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 09:12:52,534 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 09:12:52,536 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,536 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:52,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:52,536 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,536 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:52,537 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:52,537 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 09:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,537 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 09:12:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 09:12:52,538 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:52,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,540 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 09:12:52,540 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 09:12:52,541 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 09:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:52,542 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 09:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a931eda[Count = 1] remaining members to acquire global barrier 2023-07-15 09:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,543 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:52,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:52,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 09:12:52,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a931eda[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:52,546 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 09:12:52,546 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,547 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,547 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 09:12:52,547 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,548 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 09:12:52,548 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 09:12:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 09:12:52,548 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:52,549 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,549 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:52,550 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 09:12:52,550 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:52,550 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 09:12:52,565 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:52,565 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:52,565 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:52,565 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:52,565 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. started... 2023-07-15 09:12:52,565 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:52,565 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:52,567 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bccb80aff875e46c55d8894e392af4a1: 2023-07-15 09:12:52,567 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. started... 2023-07-15 09:12:52,568 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,568 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:52,568 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:12:52,586 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd488bcf9f623f21a9b8114e95fa1722: 2023-07-15 09:12:52,586 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,586 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:52,586 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 09:12:52,594 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:52,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 09:12:52,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:52,596 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:52,645 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. completed. 2023-07-15 09:12:52,645 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:52,646 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:52,646 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:52,646 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,646 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 09:12:52,646 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:52,647 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 09:12:52,647 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,648 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:52,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:52,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:52,648 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 09:12:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:52,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:52,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:52,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:12:52,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 09:12:52,796 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 09:12:52,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:52,798 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 09:12:53,040 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. completed. 2023-07-15 09:12:53,040 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 09:12:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:53,042 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 09:12:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 09:12:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 09:12:53,048 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 09:12:53,049 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:53,049 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:53,049 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,049 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,051 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,052 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,053 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,055 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,057 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,057 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,058 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,062 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,062 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,063 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,063 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:53,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,064 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,098 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 09:12:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:53,100 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 09:12:53,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 09:12:53,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,115 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689412372493Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689412373063 (+570 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689412373063Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689412373068 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689412373084 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689412373115 (+31 ms) 2023-07-15 09:12:53,118 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 09:12:53,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 624 msec 2023-07-15 09:12:53,601 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:53,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 09:12:53,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:53,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44901] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:12:53,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40347] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 09:12:53,663 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,663 DEBUG [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:53,663 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 09:12:53,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 09:12:53,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689412373685 (current time:1689412373685). 2023-07-15 09:12:53,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 09:12:53,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x48283bcd to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:53,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b91234e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:53,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:53,712 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48283bcd to 127.0.0.1:64993 2023-07-15 09:12:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(139): Connect 0x2fe3f716 to 127.0.0.1:64993 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 09:12:53,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@269c4774, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 09:12:53,728 DEBUG [hconnection-0x4359bba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:53,730 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:53,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 09:12:53,735 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 09:12:53,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fe3f716 to 127.0.0.1:64993 2023-07-15 09:12:53,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:12:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 09:12:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 09:12:53,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 09:12:53,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 09:12:53,739 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 09:12:53,740 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689412973740 2023-07-15 09:12:53,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 09:12:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 09:12:53,741 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 09:12:53,742 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 09:12:53,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 09:12:53,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-15 09:12:53,744 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 09:12:53,744 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689412973744 2023-07-15 09:12:53,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,752 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 09:12:53,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:53,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 09:12:53,753 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 09:12:53,754 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,754 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,755 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,755 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,755 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,755 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,756 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 09:12:53,757 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 09:12:53,757 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,757 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 09:12:53,757 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:53,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 09:12:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 09:12:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 09:12:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 09:12:53,760 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 09:12:53,760 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 09:12:53,760 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 09:12:53,760 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36901,1689412260724' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 09:12:53,761 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 09:12:53,761 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 09:12:53,761 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 09:12:53,762 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,762 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,764 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,764 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 09:12:53,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40347,1689412260661' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2250dda4[Count = 1] remaining members to acquire global barrier 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44901,1689412260598' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 09:12:53,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2250dda4[Count = 0] remaining members to acquire global barrier 2023-07-15 09:12:53,768 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 09:12:53,768 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 09:12:53,778 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 09:12:53,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,778 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 09:12:53,778 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36901,1689412260724' in zk 2023-07-15 09:12:53,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,778 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 09:12:53,778 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,779 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 09:12:53,779 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:53,779 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:53,779 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:53,780 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. started... 2023-07-15 09:12:53,780 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 09:12:53,780 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:53,780 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bccb80aff875e46c55d8894e392af4a1 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 09:12:53,780 DEBUG [member: 'jenkins-hbase4.apache.org,36901,1689412260724' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 09:12:53,781 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 09:12:53,783 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 09:12:53,783 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:53,783 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. started... 2023-07-15 09:12:53,783 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fd488bcf9f623f21a9b8114e95fa1722 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 09:12:53,802 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/.tmp/cf/a26e40c3ddd14ee0889e0f4e0041f68b 2023-07-15 09:12:53,808 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/.tmp/cf/105b3fb1714d421f8b2af0689e302164 2023-07-15 09:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/.tmp/cf/a26e40c3ddd14ee0889e0f4e0041f68b as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf/a26e40c3ddd14ee0889e0f4e0041f68b 2023-07-15 09:12:53,814 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/.tmp/cf/105b3fb1714d421f8b2af0689e302164 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf/105b3fb1714d421f8b2af0689e302164 2023-07-15 09:12:53,814 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf/a26e40c3ddd14ee0889e0f4e0041f68b, entries=2, sequenceid=6, filesize=5.0 K 2023-07-15 09:12:53,816 INFO [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for bccb80aff875e46c55d8894e392af4a1 in 36ms, sequenceid=6, compaction requested=false 2023-07-15 09:12:53,816 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 09:12:53,817 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bccb80aff875e46c55d8894e392af4a1: 2023-07-15 09:12:53,817 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,817 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:53,823 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf/a26e40c3ddd14ee0889e0f4e0041f68b] hfiles 2023-07-15 09:12:53,823 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf/a26e40c3ddd14ee0889e0f4e0041f68b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,826 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf/105b3fb1714d421f8b2af0689e302164, entries=48, sequenceid=6, filesize=8.1 K 2023-07-15 09:12:53,831 INFO [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fd488bcf9f623f21a9b8114e95fa1722 in 48ms, sequenceid=6, compaction requested=false 2023-07-15 09:12:53,836 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd488bcf9f623f21a9b8114e95fa1722: 2023-07-15 09:12:53,837 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,837 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 09:12:53,837 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf/105b3fb1714d421f8b2af0689e302164] hfiles 2023-07-15 09:12:53,837 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf/105b3fb1714d421f8b2af0689e302164 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,841 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:53,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 09:12:53,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 09:12:53,842 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 09:12:53,849 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. completed. 2023-07-15 09:12:53,849 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. completed. 2023-07-15 09:12:53,849 DEBUG [rs(jenkins-hbase4.apache.org,44901,1689412260598)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:12:53,849 DEBUG [rs(jenkins-hbase4.apache.org,40347,1689412260661)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 09:12:53,850 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40347,1689412260661' in zk 2023-07-15 09:12:53,849 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 09:12:53,850 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44901,1689412260598' in zk 2023-07-15 09:12:53,853 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,854 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,853 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 09:12:53,854 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:53,854 DEBUG [member: 'jenkins-hbase4.apache.org,44901,1689412260598' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 09:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 09:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,40347,1689412260661' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 09:12:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44901,1689412260598': 2023-07-15 09:12:53,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44901,1689412260598' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 09:12:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40347,1689412260661': 2023-07-15 09:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40347,1689412260661' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 09:12:53,874 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 09:12:53,874 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 09:12:53,874 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 09:12:53,874 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,874 INFO [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 09:12:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,877 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 09:12:53,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,878 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,880 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 09:12:53,880 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 09:12:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,882 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,883 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,883 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,887 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,887 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,888 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,888 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,887 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 09:12:53,888 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 09:12:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 09:12:53,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 09:12:53,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,890 DEBUG [(jenkins-hbase4.apache.org,41729,1689412259202)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 09:12:53,890 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:12:53,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 09:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 09:12:53,893 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:12:53,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,893 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,893 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:53,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:54,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 09:12:54,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:54,012 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:54,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689412373740Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689412373893 (+153 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689412373893Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689412373899 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689412373932 (+33 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689412374011 (+79 ms) 2023-07-15 09:12:54,018 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 09:12:54,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 277 msec 2023-07-15 09:12:54,042 DEBUG [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 09:12:54,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 09:12:54,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 09:12:54,044 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044 2023-07-15 09:12:54,044 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38909, tgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044, rawTgtDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044, srcFsUri=hdfs://localhost:38909, srcDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:12:54,071 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd 2023-07-15 09:12:54,071 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1213956415_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:54,071 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38909, inputRoot=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd, snapshotDir=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 09:12:54,085 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:12:54,126 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,127 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,127 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,128 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,128 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,129 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,129 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,213 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/hadoop-5731016018480084451.jar 2023-07-15 09:12:54,214 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,214 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,215 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,215 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,215 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,215 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 09:12:54,216 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 09:12:54,216 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 09:12:54,216 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 09:12:54,217 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 09:12:54,217 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 09:12:54,218 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 09:12:54,218 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 09:12:54,218 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 09:12:54,218 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 09:12:54,219 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 09:12:54,219 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:54,220 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:54,220 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:54,220 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:54,220 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 09:12:54,221 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:54,221 DEBUG [Listener at jenkins-hbase4.apache.org/39797] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 09:12:54,669 WARN [Listener at jenkins-hbase4.apache.org/39797] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 09:12:54,671 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 09:12:54,673 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 09:12:55,686 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:55,686 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 09:12:55,695 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0006_000001 (auth:SIMPLE) 2023-07-15 09:12:56,145 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0007_000001 (auth:SIMPLE) 2023-07-15 09:12:57,053 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:13:01,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0007_000001 (auth:SIMPLE) 2023-07-15 09:13:03,745 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0007_000001 (auth:SIMPLE) 2023-07-15 09:13:08,817 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689412268481_0007_000001 (auth:SIMPLE) 2023-07-15 09:13:10,358 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 09:13:10,358 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 09:13:10,389 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,389 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 09:13:10,390 INFO [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 09:13:10,390 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,390 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 09:13:10,390 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 09:13:10,390 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-200992565_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,391 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 09:13:10,391 DEBUG [Listener at jenkins-hbase4.apache.org/39797] snapshot.TestExportSnapshot(367): hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/export-test/export-1689412374044/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 09:13:10,399 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 09:13:10,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412390404"}]},"ts":"1689412390404"} 2023-07-15 09:13:10,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 09:13:10,407 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 09:13:10,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, UNASSIGN}] 2023-07-15 09:13:10,410 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, UNASSIGN 2023-07-15 09:13:10,411 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bccb80aff875e46c55d8894e392af4a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:13:10,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412390411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412390411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412390411"}]},"ts":"1689412390411"} 2023-07-15 09:13:10,414 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, UNASSIGN 2023-07-15 09:13:10,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fd488bcf9f623f21a9b8114e95fa1722, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:13:10,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure bccb80aff875e46c55d8894e392af4a1, server=jenkins-hbase4.apache.org,40347,1689412260661}] 2023-07-15 09:13:10,415 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412390415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689412390415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689412390415"}]},"ts":"1689412390415"} 2023-07-15 09:13:10,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure fd488bcf9f623f21a9b8114e95fa1722, server=jenkins-hbase4.apache.org,44901,1689412260598}] 2023-07-15 09:13:10,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 09:13:10,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:13:10,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bccb80aff875e46c55d8894e392af4a1, disabling compactions & flushes 2023-07-15 09:13:10,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:13:10,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:13:10,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. after waiting 0 ms 2023-07-15 09:13:10,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:13:10,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:13:10,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd488bcf9f623f21a9b8114e95fa1722, disabling compactions & flushes 2023-07-15 09:13:10,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:13:10,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:13:10,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. after waiting 0 ms 2023-07-15 09:13:10,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:13:10,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:13:10,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:10,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722. 2023-07-15 09:13:10,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd488bcf9f623f21a9b8114e95fa1722: 2023-07-15 09:13:10,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:13:10,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:13:10,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:10,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1. 2023-07-15 09:13:10,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bccb80aff875e46c55d8894e392af4a1: 2023-07-15 09:13:10,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=fd488bcf9f623f21a9b8114e95fa1722, regionState=CLOSED 2023-07-15 09:13:10,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412390583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412390583"}]},"ts":"1689412390583"} 2023-07-15 09:13:10,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:13:10,586 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bccb80aff875e46c55d8894e392af4a1, regionState=CLOSED 2023-07-15 09:13:10,587 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689412390586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689412390586"}]},"ts":"1689412390586"} 2023-07-15 09:13:10,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-15 09:13:10,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-15 09:13:10,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure bccb80aff875e46c55d8894e392af4a1, server=jenkins-hbase4.apache.org,40347,1689412260661 in 173 msec 2023-07-15 09:13:10,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure fd488bcf9f623f21a9b8114e95fa1722, server=jenkins-hbase4.apache.org,44901,1689412260598 in 169 msec 2023-07-15 09:13:10,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bccb80aff875e46c55d8894e392af4a1, UNASSIGN in 183 msec 2023-07-15 09:13:10,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 09:13:10,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=fd488bcf9f623f21a9b8114e95fa1722, UNASSIGN in 183 msec 2023-07-15 09:13:10,593 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689412390593"}]},"ts":"1689412390593"} 2023-07-15 09:13:10,594 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 09:13:10,596 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 09:13:10,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-15 09:13:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 09:13:10,706 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 09:13:10,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,710 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,711 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,712 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36901] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,715 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,715 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,715 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,715 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 09:13:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 09:13:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 09:13:10,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 09:13:10,717 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,717 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,717 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:13:10,717 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,718 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:13:10,718 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,718 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:13:10,718 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 09:13:10,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 09:13:10,718 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:13:10,719 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:13:10,720 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/recovered.edits] 2023-07-15 09:13:10,720 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf, FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/recovered.edits] 2023-07-15 09:13:10,724 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf/a26e40c3ddd14ee0889e0f4e0041f68b to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/cf/a26e40c3ddd14ee0889e0f4e0041f68b 2023-07-15 09:13:10,725 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf/105b3fb1714d421f8b2af0689e302164 to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/cf/105b3fb1714d421f8b2af0689e302164 2023-07-15 09:13:10,728 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1/recovered.edits/9.seqid 2023-07-15 09:13:10,728 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/recovered.edits/9.seqid to hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722/recovered.edits/9.seqid 2023-07-15 09:13:10,728 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bccb80aff875e46c55d8894e392af4a1 2023-07-15 09:13:10,728 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/fd488bcf9f623f21a9b8114e95fa1722 2023-07-15 09:13:10,728 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 09:13:10,731 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,735 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 09:13:10,737 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 09:13:10,738 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,738 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 09:13:10,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412390738"}]},"ts":"9223372036854775807"} 2023-07-15 09:13:10,738 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689412390738"}]},"ts":"9223372036854775807"} 2023-07-15 09:13:10,740 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 09:13:10,740 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bccb80aff875e46c55d8894e392af4a1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689412371786.bccb80aff875e46c55d8894e392af4a1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fd488bcf9f623f21a9b8114e95fa1722, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689412371786.fd488bcf9f623f21a9b8114e95fa1722.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 09:13:10,740 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 09:13:10,740 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689412390740"}]},"ts":"9223372036854775807"} 2023-07-15 09:13:10,741 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 09:13:10,743 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 36 msec 2023-07-15 09:13:10,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 09:13:10,820 INFO [Listener at jenkins-hbase4.apache.org/39797] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 09:13:10,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 09:13:10,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 09:13:10,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41729] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 09:13:10,863 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 764) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:52388 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-422737088_1 at /127.0.0.1:41846 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-200992565_17 at /127.0.0.1:43010 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-422737088_1 at /127.0.0.1:43228 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1822682432) connection to jenkins-hbase4.apache.org/172.31.14.131:33739 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f656688-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5325 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6f656688-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=692 (was 547) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1911 (was 1774) - AvailableMemoryMB LEAK? - 2023-07-15 09:13:10,864 WARN [Listener at jenkins-hbase4.apache.org/39797] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-15 09:13:10,864 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 09:13:10,876 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 09:13:10,988 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689412268481_0007_01_000001 is : 143 2023-07-15 09:13:16,166 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 09:13:25,002 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 09:13:39,119 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 09:13:39,120 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 09:13:39,231 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 09:13:39,240 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 09:13:39,241 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 09:13:39,252 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 09:13:39,356 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 09:13:39,356 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 09:13:39,356 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 09:13:39,356 INFO [Listener at jenkins-hbase4.apache.org/39797] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 09:13:39,356 DEBUG [Listener at jenkins-hbase4.apache.org/39797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34d8312b to 127.0.0.1:64993 2023-07-15 09:13:39,356 DEBUG [Listener at jenkins-hbase4.apache.org/39797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,356 DEBUG [Listener at jenkins-hbase4.apache.org/39797] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 09:13:39,357 DEBUG [Listener at jenkins-hbase4.apache.org/39797] util.JVMClusterUtil(257): Found active master hash=1872571225, stopped=false 2023-07-15 09:13:39,357 DEBUG [Listener at jenkins-hbase4.apache.org/39797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,357 DEBUG [Listener at jenkins-hbase4.apache.org/39797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 09:13:39,357 INFO [Listener at jenkins-hbase4.apache.org/39797] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:13:39,358 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 09:13:39,358 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 09:13:39,359 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 09:13:39,359 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:13:39,359 INFO [Listener at jenkins-hbase4.apache.org/39797] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 09:13:39,358 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 09:13:39,359 DEBUG [Listener at jenkins-hbase4.apache.org/39797] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c43d08d to 127.0.0.1:64993 2023-07-15 09:13:39,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:13:39,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:13:39,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:13:39,359 DEBUG [Listener at jenkins-hbase4.apache.org/39797] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 09:13:39,360 INFO [Listener at jenkins-hbase4.apache.org/39797] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44901,1689412260598' ***** 2023-07-15 09:13:39,360 DEBUG [Listener at jenkins-hbase4.apache.org/39797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,360 INFO [Listener at jenkins-hbase4.apache.org/39797] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 09:13:39,360 INFO [Listener at jenkins-hbase4.apache.org/39797] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40347,1689412260661' ***** 2023-07-15 09:13:39,360 DEBUG [Listener at jenkins-hbase4.apache.org/39797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,360 INFO [Listener at jenkins-hbase4.apache.org/39797] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 09:13:39,360 INFO [Listener at jenkins-hbase4.apache.org/39797] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36901,1689412260724' ***** 2023-07-15 09:13:39,360 DEBUG [Listener at jenkins-hbase4.apache.org/39797] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,360 INFO [Listener at jenkins-hbase4.apache.org/39797] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 09:13:39,361 INFO [RS:2;jenkins-hbase4:36901] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 09:13:39,361 INFO [RS:1;jenkins-hbase4:40347] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 09:13:39,361 INFO [RS:2;jenkins-hbase4:36901] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 09:13:39,361 INFO [RS:0;jenkins-hbase4:44901] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 09:13:39,361 INFO [RS:2;jenkins-hbase4:36901] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 09:13:39,361 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 09:13:39,361 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 09:13:39,361 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(3305): Received CLOSE for 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:13:39,361 INFO [RS:1;jenkins-hbase4:40347] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 09:13:39,361 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 09:13:39,362 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:13:39,362 DEBUG [RS:2;jenkins-hbase4:36901] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47d936fa to 127.0.0.1:64993 2023-07-15 09:13:39,362 DEBUG [RS:2;jenkins-hbase4:36901] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 732ddc5a869d77de3f910ca12c40797f, disabling compactions & flushes 2023-07-15 09:13:39,361 INFO [RS:0;jenkins-hbase4:44901] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 09:13:39,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:13:39,364 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 09:13:39,361 INFO [RS:1;jenkins-hbase4:40347] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 09:13:39,364 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1478): Online Regions={732ddc5a869d77de3f910ca12c40797f=hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f.} 2023-07-15 09:13:39,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:13:39,364 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(3305): Received CLOSE for 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:13:39,364 INFO [RS:0;jenkins-hbase4:44901] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 09:13:39,364 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:13:39,364 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:13:39,364 DEBUG [RS:1;jenkins-hbase4:40347] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48038a99 to 127.0.0.1:64993 2023-07-15 09:13:39,364 DEBUG [RS:0;jenkins-hbase4:44901] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2150e14d to 127.0.0.1:64993 2023-07-15 09:13:39,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. after waiting 0 ms 2023-07-15 09:13:39,365 DEBUG [RS:0;jenkins-hbase4:44901] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2cfd2b74610013f4dd58ef21bd029e57, disabling compactions & flushes 2023-07-15 09:13:39,364 DEBUG [RS:1;jenkins-hbase4:40347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,367 INFO [RS:0;jenkins-hbase4:44901] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 09:13:39,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:13:39,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:13:39,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:13:39,368 DEBUG [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1504): Waiting on 732ddc5a869d77de3f910ca12c40797f 2023-07-15 09:13:39,368 INFO [RS:0;jenkins-hbase4:44901] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 09:13:39,368 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 09:13:39,368 INFO [RS:0;jenkins-hbase4:44901] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 09:13:39,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 732ddc5a869d77de3f910ca12c40797f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 09:13:39,368 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 09:13:39,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. after waiting 0 ms 2023-07-15 09:13:39,368 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1478): Online Regions={2cfd2b74610013f4dd58ef21bd029e57=hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57.} 2023-07-15 09:13:39,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:13:39,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2cfd2b74610013f4dd58ef21bd029e57 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 09:13:39,368 DEBUG [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1504): Waiting on 2cfd2b74610013f4dd58ef21bd029e57 2023-07-15 09:13:39,369 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 09:13:39,369 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-15 09:13:39,369 DEBUG [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 09:13:39,370 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 09:13:39,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 09:13:39,370 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 09:13:39,370 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 09:13:39,370 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 09:13:39,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 09:13:39,375 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 09:13:39,376 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 09:13:39,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,381 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 09:13:39,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/.tmp/l/5650c00030e54f3ea78147220d7f64fc 2023-07-15 09:13:39,388 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 09:13:39,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/.tmp/info/b7ee575ababd480c9b32af81c0c44cd0 2023-07-15 09:13:39,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/.tmp/info/4d3b91fcf6964ea8ae92f1cbc19706ae 2023-07-15 09:13:39,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5650c00030e54f3ea78147220d7f64fc 2023-07-15 09:13:39,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/.tmp/l/5650c00030e54f3ea78147220d7f64fc as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/l/5650c00030e54f3ea78147220d7f64fc 2023-07-15 09:13:39,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7ee575ababd480c9b32af81c0c44cd0 2023-07-15 09:13:39,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/.tmp/info/4d3b91fcf6964ea8ae92f1cbc19706ae as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/info/4d3b91fcf6964ea8ae92f1cbc19706ae 2023-07-15 09:13:39,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5650c00030e54f3ea78147220d7f64fc 2023-07-15 09:13:39,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/l/5650c00030e54f3ea78147220d7f64fc, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 09:13:39,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 732ddc5a869d77de3f910ca12c40797f in 34ms, sequenceid=18, compaction requested=false 2023-07-15 09:13:39,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/info/4d3b91fcf6964ea8ae92f1cbc19706ae, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 09:13:39,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2cfd2b74610013f4dd58ef21bd029e57 in 35ms, sequenceid=6, compaction requested=false 2023-07-15 09:13:39,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/namespace/2cfd2b74610013f4dd58ef21bd029e57/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 09:13:39,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/acl/732ddc5a869d77de3f910ca12c40797f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 09:13:39,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:13:39,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2cfd2b74610013f4dd58ef21bd029e57: 2023-07-15 09:13:39,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689412263654.2cfd2b74610013f4dd58ef21bd029e57. 2023-07-15 09:13:39,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:13:39,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 732ddc5a869d77de3f910ca12c40797f: 2023-07-15 09:13:39,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689412264573.732ddc5a869d77de3f910ca12c40797f. 2023-07-15 09:13:39,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/.tmp/rep_barrier/43f830c1edee4e1a90847ab62eeab214 2023-07-15 09:13:39,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43f830c1edee4e1a90847ab62eeab214 2023-07-15 09:13:39,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/.tmp/table/6fd96fb272d749bda7a6de93fd521d18 2023-07-15 09:13:39,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fd96fb272d749bda7a6de93fd521d18 2023-07-15 09:13:39,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/.tmp/info/b7ee575ababd480c9b32af81c0c44cd0 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/info/b7ee575ababd480c9b32af81c0c44cd0 2023-07-15 09:13:39,458 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7ee575ababd480c9b32af81c0c44cd0 2023-07-15 09:13:39,458 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/info/b7ee575ababd480c9b32af81c0c44cd0, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 09:13:39,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/.tmp/rep_barrier/43f830c1edee4e1a90847ab62eeab214 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/rep_barrier/43f830c1edee4e1a90847ab62eeab214 2023-07-15 09:13:39,467 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43f830c1edee4e1a90847ab62eeab214 2023-07-15 09:13:39,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/rep_barrier/43f830c1edee4e1a90847ab62eeab214, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 09:13:39,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/.tmp/table/6fd96fb272d749bda7a6de93fd521d18 as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/table/6fd96fb272d749bda7a6de93fd521d18 2023-07-15 09:13:39,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fd96fb272d749bda7a6de93fd521d18 2023-07-15 09:13:39,475 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/table/6fd96fb272d749bda7a6de93fd521d18, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 09:13:39,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 106ms, sequenceid=131, compaction requested=false 2023-07-15 09:13:39,500 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 09:13:39,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 09:13:39,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 09:13:39,503 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 09:13:39,503 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 09:13:39,503 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 09:13:39,568 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36901,1689412260724; all regions closed. 2023-07-15 09:13:39,568 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40347,1689412260661; all regions closed. 2023-07-15 09:13:39,569 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44901,1689412260598; all regions closed. 2023-07-15 09:13:39,602 DEBUG [RS:1;jenkins-hbase4:40347] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs 2023-07-15 09:13:39,603 DEBUG [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs 2023-07-15 09:13:39,603 INFO [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44901%2C1689412260598.meta:.meta(num 1689412263244) 2023-07-15 09:13:39,603 INFO [RS:1;jenkins-hbase4:40347] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40347%2C1689412260661:(num 1689412262876) 2023-07-15 09:13:39,603 DEBUG [RS:1;jenkins-hbase4:40347] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,603 INFO [RS:1;jenkins-hbase4:40347] regionserver.LeaseManager(133): Closed leases 2023-07-15 09:13:39,603 INFO [RS:1;jenkins-hbase4:40347] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 09:13:39,604 INFO [RS:1;jenkins-hbase4:40347] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 09:13:39,604 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 09:13:39,604 INFO [RS:1;jenkins-hbase4:40347] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 09:13:39,604 INFO [RS:1;jenkins-hbase4:40347] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 09:13:39,607 INFO [RS:1;jenkins-hbase4:40347] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40347 2023-07-15 09:13:39,610 DEBUG [RS:2;jenkins-hbase4:36901] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs 2023-07-15 09:13:39,610 INFO [RS:2;jenkins-hbase4:36901] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36901%2C1689412260724:(num 1689412262873) 2023-07-15 09:13:39,610 DEBUG [RS:2;jenkins-hbase4:36901] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,610 INFO [RS:2;jenkins-hbase4:36901] regionserver.LeaseManager(133): Closed leases 2023-07-15 09:13:39,610 INFO [RS:2;jenkins-hbase4:36901] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 09:13:39,615 INFO [RS:2;jenkins-hbase4:36901] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 09:13:39,615 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 09:13:39,615 INFO [RS:2;jenkins-hbase4:36901] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 09:13:39,616 INFO [RS:2;jenkins-hbase4:36901] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 09:13:39,616 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:13:39,616 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:13:39,616 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:13:39,617 INFO [RS:2;jenkins-hbase4:36901] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36901 2023-07-15 09:13:39,618 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:13:39,618 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40347,1689412260661 2023-07-15 09:13:39,618 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:13:39,618 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:13:39,618 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40347,1689412260661] 2023-07-15 09:13:39,619 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40347,1689412260661; numProcessing=1 2023-07-15 09:13:39,620 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:13:39,620 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36901,1689412260724 2023-07-15 09:13:39,620 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:13:39,620 DEBUG [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/oldWALs 2023-07-15 09:13:39,620 INFO [RS:0;jenkins-hbase4:44901] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44901%2C1689412260598:(num 1689412262872) 2023-07-15 09:13:39,620 DEBUG [RS:0;jenkins-hbase4:44901] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,620 INFO [RS:0;jenkins-hbase4:44901] regionserver.LeaseManager(133): Closed leases 2023-07-15 09:13:39,621 INFO [RS:0;jenkins-hbase4:44901] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 09:13:39,621 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 09:13:39,622 INFO [RS:0;jenkins-hbase4:44901] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44901 2023-07-15 09:13:39,622 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40347,1689412260661 already deleted, retry=false 2023-07-15 09:13:39,623 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40347,1689412260661 expired; onlineServers=2 2023-07-15 09:13:39,720 INFO [RS:1;jenkins-hbase4:40347] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40347,1689412260661; zookeeper connection closed. 2023-07-15 09:13:39,720 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:39,720 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:40347-0x101683fccb70002, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:39,720 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36901,1689412260724] 2023-07-15 09:13:39,720 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36901,1689412260724; numProcessing=2 2023-07-15 09:13:39,720 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@53c17d79] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@53c17d79 2023-07-15 09:13:39,721 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:13:39,721 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44901,1689412260598 2023-07-15 09:13:39,721 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 09:13:39,722 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36901,1689412260724 already deleted, retry=false 2023-07-15 09:13:39,722 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36901,1689412260724 expired; onlineServers=1 2023-07-15 09:13:39,723 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44901,1689412260598] 2023-07-15 09:13:39,723 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44901,1689412260598; numProcessing=3 2023-07-15 09:13:39,822 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:39,822 INFO [RS:2;jenkins-hbase4:36901] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36901,1689412260724; zookeeper connection closed. 2023-07-15 09:13:39,822 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:36901-0x101683fccb70003, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:39,822 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40dad7cc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40dad7cc 2023-07-15 09:13:39,824 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:39,824 INFO [RS:0;jenkins-hbase4:44901] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44901,1689412260598; zookeeper connection closed. 2023-07-15 09:13:39,824 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): regionserver:44901-0x101683fccb70001, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:39,824 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2a274043] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2a274043 2023-07-15 09:13:39,824 INFO [Listener at jenkins-hbase4.apache.org/39797] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 09:13:39,825 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44901,1689412260598 already deleted, retry=false 2023-07-15 09:13:39,825 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44901,1689412260598 expired; onlineServers=0 2023-07-15 09:13:39,825 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41729,1689412259202' ***** 2023-07-15 09:13:39,825 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 09:13:39,825 DEBUG [M:0;jenkins-hbase4:41729] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ea02162, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 09:13:39,825 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41729,1689412259202 2023-07-15 09:13:39,825 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41729,1689412259202; all regions closed. 2023-07-15 09:13:39,825 DEBUG [M:0;jenkins-hbase4:41729] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 09:13:39,826 DEBUG [M:0;jenkins-hbase4:41729] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 09:13:39,826 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 09:13:39,826 DEBUG [M:0;jenkins-hbase4:41729] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 09:13:39,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689412262351] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689412262351,5,FailOnTimeoutGroup] 2023-07-15 09:13:39,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689412262345] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689412262345,5,FailOnTimeoutGroup] 2023-07-15 09:13:39,826 INFO [M:0;jenkins-hbase4:41729] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 09:13:39,826 INFO [M:0;jenkins-hbase4:41729] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 09:13:39,826 INFO [M:0;jenkins-hbase4:41729] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 09:13:39,826 DEBUG [M:0;jenkins-hbase4:41729] master.HMaster(1512): Stopping service threads 2023-07-15 09:13:39,826 INFO [M:0;jenkins-hbase4:41729] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 09:13:39,827 ERROR [M:0;jenkins-hbase4:41729] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 09:13:39,827 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 09:13:39,827 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 09:13:39,827 INFO [M:0;jenkins-hbase4:41729] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 09:13:39,828 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 09:13:39,830 DEBUG [M:0;jenkins-hbase4:41729] zookeeper.ZKUtil(398): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 09:13:39,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 09:13:39,830 WARN [M:0;jenkins-hbase4:41729] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 09:13:39,830 INFO [M:0;jenkins-hbase4:41729] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 09:13:39,830 INFO [M:0;jenkins-hbase4:41729] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 09:13:39,831 DEBUG [M:0;jenkins-hbase4:41729] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 09:13:39,831 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:13:39,831 DEBUG [M:0;jenkins-hbase4:41729] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:13:39,831 DEBUG [M:0;jenkins-hbase4:41729] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 09:13:39,831 DEBUG [M:0;jenkins-hbase4:41729] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:13:39,832 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.35 KB heapSize=449.55 KB 2023-07-15 09:13:39,861 INFO [M:0;jenkins-hbase4:41729] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.35 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7d63a031f704479bc72ace2cee5a6bf 2023-07-15 09:13:39,865 INFO [M:0;jenkins-hbase4:41729] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7d63a031f704479bc72ace2cee5a6bf 2023-07-15 09:13:39,866 DEBUG [M:0;jenkins-hbase4:41729] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7d63a031f704479bc72ace2cee5a6bf as hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7d63a031f704479bc72ace2cee5a6bf 2023-07-15 09:13:39,872 INFO [M:0;jenkins-hbase4:41729] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7d63a031f704479bc72ace2cee5a6bf 2023-07-15 09:13:39,873 INFO [M:0;jenkins-hbase4:41729] regionserver.HStore(1080): Added hdfs://localhost:38909/user/jenkins/test-data/03d65bf1-c589-43ac-514c-1dd6d586b2cd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7d63a031f704479bc72ace2cee5a6bf, entries=119, sequenceid=899, filesize=28.5 K 2023-07-15 09:13:39,874 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegion(2948): Finished flush of dataSize ~373.35 KB/382313, heapSize ~449.53 KB/460320, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=899, compaction requested=false 2023-07-15 09:13:39,884 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 09:13:39,884 DEBUG [M:0;jenkins-hbase4:41729] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 09:13:39,889 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 09:13:39,889 INFO [M:0;jenkins-hbase4:41729] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 09:13:39,890 INFO [M:0;jenkins-hbase4:41729] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41729 2023-07-15 09:13:39,910 DEBUG [M:0;jenkins-hbase4:41729] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41729,1689412259202 already deleted, retry=false 2023-07-15 09:13:40,012 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:40,012 INFO [M:0;jenkins-hbase4:41729] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41729,1689412259202; zookeeper connection closed. 2023-07-15 09:13:40,012 DEBUG [Listener at localhost/37585-EventThread] zookeeper.ZKWatcher(600): master:41729-0x101683fccb70000, quorum=127.0.0.1:64993, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 09:13:40,014 WARN [Listener at jenkins-hbase4.apache.org/39797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 09:13:40,020 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 09:13:40,124 WARN [BP-1704537798-172.31.14.131-1689412255121 heartbeating to localhost/127.0.0.1:38909] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 09:13:40,124 WARN [BP-1704537798-172.31.14.131-1689412255121 heartbeating to localhost/127.0.0.1:38909] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1704537798-172.31.14.131-1689412255121 (Datanode Uuid 3a03f69e-ae93-49d8-845c-ee5bb438c11d) service to localhost/127.0.0.1:38909 2023-07-15 09:13:40,126 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data5/current/BP-1704537798-172.31.14.131-1689412255121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 09:13:40,126 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data6/current/BP-1704537798-172.31.14.131-1689412255121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 09:13:40,128 WARN [Listener at jenkins-hbase4.apache.org/39797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 09:13:40,130 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 09:13:40,233 WARN [BP-1704537798-172.31.14.131-1689412255121 heartbeating to localhost/127.0.0.1:38909] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 09:13:40,233 WARN [BP-1704537798-172.31.14.131-1689412255121 heartbeating to localhost/127.0.0.1:38909] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1704537798-172.31.14.131-1689412255121 (Datanode Uuid c237a64d-d1bd-45f6-bcf7-9bb6de3b7db7) service to localhost/127.0.0.1:38909 2023-07-15 09:13:40,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data3/current/BP-1704537798-172.31.14.131-1689412255121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 09:13:40,234 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data4/current/BP-1704537798-172.31.14.131-1689412255121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 09:13:40,236 WARN [Listener at jenkins-hbase4.apache.org/39797] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 09:13:40,238 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 09:13:40,240 WARN [BP-1704537798-172.31.14.131-1689412255121 heartbeating to localhost/127.0.0.1:38909] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 09:13:40,241 WARN [BP-1704537798-172.31.14.131-1689412255121 heartbeating to localhost/127.0.0.1:38909] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1704537798-172.31.14.131-1689412255121 (Datanode Uuid f8d5c4ed-f9e4-44f2-9582-15c78c24a8de) service to localhost/127.0.0.1:38909 2023-07-15 09:13:40,241 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data1/current/BP-1704537798-172.31.14.131-1689412255121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 09:13:40,242 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b53d01af-7204-3dd4-a80d-69875e4177fb/cluster_8dc0ceaf-c8ca-a5d3-f8b3-6d780be0b1d1/dfs/data/data2/current/BP-1704537798-172.31.14.131-1689412255121] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 09:13:40,268 INFO [Listener at jenkins-hbase4.apache.org/39797] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 09:13:40,394 INFO [Listener at jenkins-hbase4.apache.org/39797] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 09:13:40,520 INFO [Listener at jenkins-hbase4.apache.org/39797] hbase.HBaseTestingUtility(1293): Minicluster is down