2023-07-24 13:06:05,010 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 13:06:05,270 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b 2023-07-24 13:06:05,270 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 13:06:05,271 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 13:06:05,314 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 13:06:05,647 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 13:06:05,648 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252, deleteOnExit=true 2023-07-24 13:06:05,648 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 13:06:05,649 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/test.cache.data in system properties and HBase conf 2023-07-24 13:06:05,649 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 13:06:05,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop.log.dir in system properties and HBase conf 2023-07-24 13:06:05,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 13:06:05,651 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 13:06:05,651 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 13:06:06,023 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 13:06:06,029 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:06,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:06,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 13:06:06,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:06,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 13:06:06,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 13:06:06,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:06,033 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:06,033 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 13:06:06,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/nfs.dump.dir in system properties and HBase conf 2023-07-24 13:06:06,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir in system properties and HBase conf 2023-07-24 13:06:06,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:06,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 13:06:06,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 13:06:06,731 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 13:06:06,736 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 13:06:07,104 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 13:06:07,298 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 13:06:07,318 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:07,373 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:07,410 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_localhost_46845_hdfs____cb7nhd/webapp 2023-07-24 13:06:07,578 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46845 2023-07-24 13:06:07,638 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 13:06:07,638 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 13:06:08,249 WARN [Listener at localhost/37143] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:08,350 WARN [Listener at localhost/37143] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 13:06:08,379 WARN [Listener at localhost/37143] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:08,388 INFO [Listener at localhost/37143] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:08,399 INFO [Listener at localhost/37143] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_localhost_41199_datanode____.i9e4kl/webapp 2023-07-24 13:06:08,548 INFO [Listener at localhost/37143] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41199 2023-07-24 13:06:09,116 WARN [Listener at localhost/45841] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:09,160 WARN [Listener at localhost/45841] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 13:06:09,171 WARN [Listener at localhost/45841] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:09,173 INFO [Listener at localhost/45841] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:09,183 INFO [Listener at localhost/45841] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_localhost_42303_datanode____.ejdvc1/webapp 2023-07-24 13:06:09,333 INFO [Listener at localhost/45841] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42303 2023-07-24 13:06:09,366 WARN [Listener at localhost/42087] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:09,417 WARN [Listener at localhost/42087] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 13:06:09,423 WARN [Listener at localhost/42087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:09,425 INFO [Listener at localhost/42087] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:09,444 INFO [Listener at localhost/42087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_localhost_39759_datanode____3tfg4c/webapp 2023-07-24 13:06:09,664 INFO [Listener at localhost/42087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39759 2023-07-24 13:06:09,717 WARN [Listener at localhost/33675] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:10,134 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1a942bf9fca4ab29: Processing first storage report for DS-e283215c-099d-4b95-ba5e-08199c440494 from datanode 79a1c959-ee9a-4960-a5ce-a17cb1dcecd6 2023-07-24 13:06:10,136 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1a942bf9fca4ab29: from storage DS-e283215c-099d-4b95-ba5e-08199c440494 node DatanodeRegistration(127.0.0.1:33145, datanodeUuid=79a1c959-ee9a-4960-a5ce-a17cb1dcecd6, infoPort=41883, infoSecurePort=0, ipcPort=33675, storageInfo=lv=-57;cid=testClusterID;nsid=1065186449;c=1690203966826), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,136 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x989c7dc0943ed3b1: Processing first storage report for DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a from datanode f3d63c86-5fd3-4e76-8598-323c1e82607f 2023-07-24 13:06:10,136 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x989c7dc0943ed3b1: from storage DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a node DatanodeRegistration(127.0.0.1:33737, datanodeUuid=f3d63c86-5fd3-4e76-8598-323c1e82607f, infoPort=42625, infoSecurePort=0, ipcPort=45841, storageInfo=lv=-57;cid=testClusterID;nsid=1065186449;c=1690203966826), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,136 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x913e5e9b3256d5b4: Processing first storage report for DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d from datanode 2b4f0577-1fde-4091-8ba3-f8858c5b30f6 2023-07-24 13:06:10,136 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x913e5e9b3256d5b4: from storage DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d node DatanodeRegistration(127.0.0.1:42413, datanodeUuid=2b4f0577-1fde-4091-8ba3-f8858c5b30f6, infoPort=42905, infoSecurePort=0, ipcPort=42087, storageInfo=lv=-57;cid=testClusterID;nsid=1065186449;c=1690203966826), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,137 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1a942bf9fca4ab29: Processing first storage report for DS-301e36dc-9250-413e-be0a-3261fee77c16 from datanode 79a1c959-ee9a-4960-a5ce-a17cb1dcecd6 2023-07-24 13:06:10,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1a942bf9fca4ab29: from storage DS-301e36dc-9250-413e-be0a-3261fee77c16 node DatanodeRegistration(127.0.0.1:33145, datanodeUuid=79a1c959-ee9a-4960-a5ce-a17cb1dcecd6, infoPort=41883, infoSecurePort=0, ipcPort=33675, storageInfo=lv=-57;cid=testClusterID;nsid=1065186449;c=1690203966826), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,137 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x989c7dc0943ed3b1: Processing first storage report for DS-2761f61b-0030-4da8-8e78-2a8fc029119a from datanode f3d63c86-5fd3-4e76-8598-323c1e82607f 2023-07-24 13:06:10,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x989c7dc0943ed3b1: from storage DS-2761f61b-0030-4da8-8e78-2a8fc029119a node DatanodeRegistration(127.0.0.1:33737, datanodeUuid=f3d63c86-5fd3-4e76-8598-323c1e82607f, infoPort=42625, infoSecurePort=0, ipcPort=45841, storageInfo=lv=-57;cid=testClusterID;nsid=1065186449;c=1690203966826), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,137 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x913e5e9b3256d5b4: Processing first storage report for DS-feb6ce72-3da9-4718-b985-5a5ce5814d6f from datanode 2b4f0577-1fde-4091-8ba3-f8858c5b30f6 2023-07-24 13:06:10,137 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x913e5e9b3256d5b4: from storage DS-feb6ce72-3da9-4718-b985-5a5ce5814d6f node DatanodeRegistration(127.0.0.1:42413, datanodeUuid=2b4f0577-1fde-4091-8ba3-f8858c5b30f6, infoPort=42905, infoSecurePort=0, ipcPort=42087, storageInfo=lv=-57;cid=testClusterID;nsid=1065186449;c=1690203966826), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,388 DEBUG [Listener at localhost/33675] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b 2023-07-24 13:06:10,483 INFO [Listener at localhost/33675] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/zookeeper_0, clientPort=63130, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 13:06:10,504 INFO [Listener at localhost/33675] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63130 2023-07-24 13:06:10,514 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:10,518 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:11,220 INFO [Listener at localhost/33675] util.FSUtils(471): Created version file at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e with version=8 2023-07-24 13:06:11,221 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/hbase-staging 2023-07-24 13:06:11,597 INFO [Listener at localhost/33675] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 13:06:12,219 INFO [Listener at localhost/33675] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:12,257 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,257 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,258 INFO [Listener at localhost/33675] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:12,258 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,258 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:12,430 INFO [Listener at localhost/33675] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:12,514 DEBUG [Listener at localhost/33675] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 13:06:12,633 INFO [Listener at localhost/33675] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39637 2023-07-24 13:06:12,647 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,649 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,674 INFO [Listener at localhost/33675] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39637 connecting to ZooKeeper ensemble=127.0.0.1:63130 2023-07-24 13:06:12,744 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:396370x0, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:12,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39637-0x10197705e9f0000 connected 2023-07-24 13:06:12,794 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:12,799 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:12,818 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:12,846 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39637 2023-07-24 13:06:12,847 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39637 2023-07-24 13:06:12,854 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39637 2023-07-24 13:06:12,855 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39637 2023-07-24 13:06:12,857 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39637 2023-07-24 13:06:12,864 INFO [Listener at localhost/33675] master.HMaster(444): hbase.rootdir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, hbase.cluster.distributed=false 2023-07-24 13:06:12,955 INFO [Listener at localhost/33675] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:12,956 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,956 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,956 INFO [Listener at localhost/33675] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:12,956 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,956 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:12,961 INFO [Listener at localhost/33675] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:12,967 INFO [Listener at localhost/33675] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41971 2023-07-24 13:06:12,970 INFO [Listener at localhost/33675] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 13:06:12,979 INFO [Listener at localhost/33675] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 13:06:12,980 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,982 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,985 INFO [Listener at localhost/33675] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41971 connecting to ZooKeeper ensemble=127.0.0.1:63130 2023-07-24 13:06:12,992 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:419710x0, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:12,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41971-0x10197705e9f0001 connected 2023-07-24 13:06:12,993 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:12,995 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:12,997 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:12,999 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41971 2023-07-24 13:06:13,002 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41971 2023-07-24 13:06:13,003 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41971 2023-07-24 13:06:13,007 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41971 2023-07-24 13:06:13,010 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41971 2023-07-24 13:06:13,025 INFO [Listener at localhost/33675] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:13,025 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:13,025 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:13,026 INFO [Listener at localhost/33675] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:13,026 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:13,027 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:13,027 INFO [Listener at localhost/33675] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:13,029 INFO [Listener at localhost/33675] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43445 2023-07-24 13:06:13,030 INFO [Listener at localhost/33675] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 13:06:13,031 INFO [Listener at localhost/33675] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 13:06:13,033 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,035 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,038 INFO [Listener at localhost/33675] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43445 connecting to ZooKeeper ensemble=127.0.0.1:63130 2023-07-24 13:06:13,043 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:434450x0, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:13,044 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:434450x0, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:13,045 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:434450x0, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:13,047 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:434450x0, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:13,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43445-0x10197705e9f0002 connected 2023-07-24 13:06:13,048 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43445 2023-07-24 13:06:13,049 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43445 2023-07-24 13:06:13,050 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43445 2023-07-24 13:06:13,058 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43445 2023-07-24 13:06:13,059 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43445 2023-07-24 13:06:13,072 INFO [Listener at localhost/33675] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:13,073 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:13,073 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:13,073 INFO [Listener at localhost/33675] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:13,073 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:13,074 INFO [Listener at localhost/33675] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:13,074 INFO [Listener at localhost/33675] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:13,076 INFO [Listener at localhost/33675] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37237 2023-07-24 13:06:13,076 INFO [Listener at localhost/33675] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 13:06:13,078 INFO [Listener at localhost/33675] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 13:06:13,080 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,081 INFO [Listener at localhost/33675] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,083 INFO [Listener at localhost/33675] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37237 connecting to ZooKeeper ensemble=127.0.0.1:63130 2023-07-24 13:06:13,095 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:372370x0, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:13,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37237-0x10197705e9f0003 connected 2023-07-24 13:06:13,097 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:13,098 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:13,099 DEBUG [Listener at localhost/33675] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:13,102 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37237 2023-07-24 13:06:13,103 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37237 2023-07-24 13:06:13,105 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37237 2023-07-24 13:06:13,106 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37237 2023-07-24 13:06:13,106 DEBUG [Listener at localhost/33675] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37237 2023-07-24 13:06:13,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:13,130 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 13:06:13,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:13,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,154 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:13,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 13:06:13,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39637,1690203971407 from backup master directory 2023-07-24 13:06:13,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 13:06:13,166 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:13,166 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 13:06:13,167 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:13,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:13,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 13:06:13,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 13:06:13,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/hbase.id with ID: dfbb8a19-8c10-4a7f-9dbc-ea2935106c14 2023-07-24 13:06:13,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,396 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:13,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x26336b82 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:13,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c71d6a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:13,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:13,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 13:06:13,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 13:06:13,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 13:06:13,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 13:06:13,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 13:06:13,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:13,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store-tmp 2023-07-24 13:06:13,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:13,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 13:06:13,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 13:06:13,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 13:06:13,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/WALs/jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:13,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39637%2C1690203971407, suffix=, logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/WALs/jenkins-hbase4.apache.org,39637,1690203971407, archiveDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/oldWALs, maxLogs=10 2023-07-24 13:06:13,820 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK] 2023-07-24 13:06:13,820 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK] 2023-07-24 13:06:13,820 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK] 2023-07-24 13:06:13,832 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 13:06:13,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/WALs/jenkins-hbase4.apache.org,39637,1690203971407/jenkins-hbase4.apache.org%2C39637%2C1690203971407.1690203973720 2023-07-24 13:06:13,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK], DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK], DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK]] 2023-07-24 13:06:13,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:13,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:13,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:13,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:14,030 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:14,039 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 13:06:14,080 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 13:06:14,097 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:14,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:14,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:14,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:14,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:14,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68227990, jitterRate=0.016676276922225952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:14,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 13:06:14,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 13:06:14,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 13:06:14,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 13:06:14,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 13:06:14,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 13:06:14,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-24 13:06:14,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 13:06:14,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 13:06:14,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 13:06:14,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 13:06:14,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 13:06:14,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 13:06:14,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 13:06:14,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 13:06:14,291 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 13:06:14,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 13:06:14,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 13:06:14,322 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,322 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,322 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,322 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,322 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39637,1690203971407, sessionid=0x10197705e9f0000, setting cluster-up flag (Was=false) 2023-07-24 13:06:14,351 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 13:06:14,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:14,370 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 13:06:14,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:14,382 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp 2023-07-24 13:06:14,418 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(951): ClusterId : dfbb8a19-8c10-4a7f-9dbc-ea2935106c14 2023-07-24 13:06:14,421 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(951): ClusterId : dfbb8a19-8c10-4a7f-9dbc-ea2935106c14 2023-07-24 13:06:14,431 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 13:06:14,431 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 13:06:14,432 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(951): ClusterId : dfbb8a19-8c10-4a7f-9dbc-ea2935106c14 2023-07-24 13:06:14,437 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 13:06:14,444 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 13:06:14,444 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 13:06:14,444 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 13:06:14,444 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 13:06:14,444 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 13:06:14,444 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 13:06:14,449 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 13:06:14,449 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 13:06:14,455 DEBUG [RS:2;jenkins-hbase4:37237] zookeeper.ReadOnlyZKClient(139): Connect 0x774278ee to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:14,455 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 13:06:14,460 DEBUG [RS:0;jenkins-hbase4:41971] zookeeper.ReadOnlyZKClient(139): Connect 0x4c49a4e3 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:14,470 DEBUG [RS:1;jenkins-hbase4:43445] zookeeper.ReadOnlyZKClient(139): Connect 0x1c306437 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:14,495 DEBUG [RS:0;jenkins-hbase4:41971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@428e431a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:14,495 DEBUG [RS:2;jenkins-hbase4:37237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79858876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:14,496 DEBUG [RS:0;jenkins-hbase4:41971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46b1cf93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:06:14,496 DEBUG [RS:2;jenkins-hbase4:37237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dba139e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:06:14,540 DEBUG [RS:1;jenkins-hbase4:43445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12f789c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:14,540 DEBUG [RS:1;jenkins-hbase4:43445] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16c80f47, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:06:14,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 13:06:14,569 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43445 2023-07-24 13:06:14,569 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41971 2023-07-24 13:06:14,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 13:06:14,577 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:37237 2023-07-24 13:06:14,577 INFO [RS:1;jenkins-hbase4:43445] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 13:06:14,578 INFO [RS:1;jenkins-hbase4:43445] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 13:06:14,578 INFO [RS:0;jenkins-hbase4:41971] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 13:06:14,578 INFO [RS:0;jenkins-hbase4:41971] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 13:06:14,579 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 13:06:14,578 INFO [RS:2;jenkins-hbase4:37237] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 13:06:14,581 INFO [RS:1;jenkins-hbase4:43445] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,579 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 13:06:14,582 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 13:06:14,582 INFO [RS:2;jenkins-hbase4:37237] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 13:06:14,583 INFO [RS:0;jenkins-hbase4:41971] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,583 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 13:06:14,583 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 13:06:14,583 INFO [RS:2;jenkins-hbase4:37237] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,583 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 13:06:14,587 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39637,1690203971407 with isa=jenkins-hbase4.apache.org/172.31.14.131:41971, startcode=1690203972955 2023-07-24 13:06:14,587 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39637,1690203971407 with isa=jenkins-hbase4.apache.org/172.31.14.131:43445, startcode=1690203973024 2023-07-24 13:06:14,587 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39637,1690203971407 with isa=jenkins-hbase4.apache.org/172.31.14.131:37237, startcode=1690203973072 2023-07-24 13:06:14,619 DEBUG [RS:2;jenkins-hbase4:37237] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 13:06:14,619 DEBUG [RS:0;jenkins-hbase4:41971] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 13:06:14,619 DEBUG [RS:1;jenkins-hbase4:43445] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 13:06:14,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 13:06:14,697 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47999, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 13:06:14,700 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34683, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 13:06:14,701 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49319, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:14,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,710 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39637] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 13:06:14,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690204004719 2023-07-24 13:06:14,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 13:06:14,724 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39637] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 13:06:14,726 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39637] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 13:06:14,726 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 13:06:14,728 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 13:06:14,735 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:14,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 13:06:14,752 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 13:06:14,752 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 13:06:14,753 WARN [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 13:06:14,752 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 13:06:14,753 WARN [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 13:06:14,753 WARN [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 13:06:14,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 13:06:14,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 13:06:14,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 13:06:14,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 13:06:14,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 13:06:14,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 13:06:14,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 13:06:14,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 13:06:14,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 13:06:14,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690203974777,5,FailOnTimeoutGroup] 2023-07-24 13:06:14,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690203974779,5,FailOnTimeoutGroup] 2023-07-24 13:06:14,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 13:06:14,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,819 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:14,821 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:14,821 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:14,854 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39637,1690203971407 with isa=jenkins-hbase4.apache.org/172.31.14.131:43445, startcode=1690203973024 2023-07-24 13:06:14,854 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39637,1690203971407 with isa=jenkins-hbase4.apache.org/172.31.14.131:41971, startcode=1690203972955 2023-07-24 13:06:14,854 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39637,1690203971407 with isa=jenkins-hbase4.apache.org/172.31.14.131:37237, startcode=1690203973072 2023-07-24 13:06:14,871 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39637] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:14,879 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39637] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:14,895 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:14,897 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:14,897 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39637] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:14,897 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37143 2023-07-24 13:06:14,897 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37143 2023-07-24 13:06:14,898 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 13:06:14,898 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 13:06:14,907 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:14,907 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37143 2023-07-24 13:06:14,907 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 13:06:14,913 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:06:14,919 DEBUG [RS:1;jenkins-hbase4:43445] zookeeper.ZKUtil(162): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:14,919 DEBUG [RS:0;jenkins-hbase4:41971] zookeeper.ZKUtil(162): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:14,919 DEBUG [RS:2;jenkins-hbase4:37237] zookeeper.ZKUtil(162): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:14,919 WARN [RS:1;jenkins-hbase4:43445] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:14,919 WARN [RS:2;jenkins-hbase4:37237] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:14,919 WARN [RS:0;jenkins-hbase4:41971] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:14,921 INFO [RS:1;jenkins-hbase4:43445] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:14,921 INFO [RS:2;jenkins-hbase4:37237] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:14,922 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:14,922 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:14,922 INFO [RS:0;jenkins-hbase4:41971] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:14,924 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:14,925 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43445,1690203973024] 2023-07-24 13:06:14,925 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37237,1690203973072] 2023-07-24 13:06:14,925 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41971,1690203972955] 2023-07-24 13:06:14,983 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:14,986 DEBUG [RS:0;jenkins-hbase4:41971] zookeeper.ZKUtil(162): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:14,986 DEBUG [RS:2;jenkins-hbase4:37237] zookeeper.ZKUtil(162): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:14,987 DEBUG [RS:0;jenkins-hbase4:41971] zookeeper.ZKUtil(162): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:14,987 DEBUG [RS:2;jenkins-hbase4:37237] zookeeper.ZKUtil(162): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:14,988 DEBUG [RS:0;jenkins-hbase4:41971] zookeeper.ZKUtil(162): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:14,988 DEBUG [RS:2;jenkins-hbase4:37237] zookeeper.ZKUtil(162): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:14,990 DEBUG [RS:1;jenkins-hbase4:43445] zookeeper.ZKUtil(162): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:14,991 DEBUG [RS:1;jenkins-hbase4:43445] zookeeper.ZKUtil(162): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:14,991 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 13:06:14,992 DEBUG [RS:1;jenkins-hbase4:43445] zookeeper.ZKUtil(162): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:14,995 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/info 2023-07-24 13:06:14,995 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 13:06:14,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:14,997 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 13:06:15,000 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/rep_barrier 2023-07-24 13:06:15,000 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 13:06:15,001 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,002 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 13:06:15,005 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/table 2023-07-24 13:06:15,005 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 13:06:15,005 DEBUG [RS:2;jenkins-hbase4:37237] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 13:06:15,005 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 13:06:15,006 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 13:06:15,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,009 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740 2023-07-24 13:06:15,011 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740 2023-07-24 13:06:15,021 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 13:06:15,024 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 13:06:15,024 INFO [RS:1;jenkins-hbase4:43445] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 13:06:15,025 INFO [RS:2;jenkins-hbase4:37237] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 13:06:15,026 INFO [RS:0;jenkins-hbase4:41971] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 13:06:15,039 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:15,040 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74954860, jitterRate=0.11691445112228394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 13:06:15,040 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 13:06:15,041 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 13:06:15,041 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 13:06:15,041 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 13:06:15,041 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 13:06:15,041 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 13:06:15,046 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 13:06:15,046 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 13:06:15,057 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 13:06:15,057 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 13:06:15,080 INFO [RS:2;jenkins-hbase4:37237] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 13:06:15,083 INFO [RS:0;jenkins-hbase4:41971] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 13:06:15,085 INFO [RS:1;jenkins-hbase4:43445] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 13:06:15,089 INFO [RS:0;jenkins-hbase4:41971] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 13:06:15,089 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 13:06:15,089 INFO [RS:1;jenkins-hbase4:43445] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 13:06:15,100 INFO [RS:2;jenkins-hbase4:37237] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 13:06:15,100 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,100 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,105 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 13:06:15,105 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 13:06:15,105 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 13:06:15,123 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,123 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,123 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,124 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,124 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,124 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,124 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,124 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,124 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:15,125 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,123 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:15,125 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,125 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:15,126 DEBUG [RS:2;jenkins-hbase4:37237] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,126 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,127 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,128 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,128 DEBUG [RS:1;jenkins-hbase4:43445] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,128 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,128 DEBUG [RS:0;jenkins-hbase4:41971] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:15,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 13:06:15,139 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,141 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,141 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,141 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,142 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,142 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,141 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,142 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,142 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,143 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 13:06:15,165 INFO [RS:0;jenkins-hbase4:41971] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 13:06:15,165 INFO [RS:2;jenkins-hbase4:37237] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 13:06:15,165 INFO [RS:1;jenkins-hbase4:43445] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 13:06:15,170 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37237,1690203973072-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,170 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41971,1690203972955-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,170 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43445,1690203973024-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,200 INFO [RS:1;jenkins-hbase4:43445] regionserver.Replication(203): jenkins-hbase4.apache.org,43445,1690203973024 started 2023-07-24 13:06:15,200 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43445,1690203973024, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43445, sessionid=0x10197705e9f0002 2023-07-24 13:06:15,200 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 13:06:15,200 DEBUG [RS:1;jenkins-hbase4:43445] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:15,201 DEBUG [RS:1;jenkins-hbase4:43445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43445,1690203973024' 2023-07-24 13:06:15,201 DEBUG [RS:1;jenkins-hbase4:43445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 13:06:15,202 DEBUG [RS:1;jenkins-hbase4:43445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 13:06:15,202 INFO [RS:0;jenkins-hbase4:41971] regionserver.Replication(203): jenkins-hbase4.apache.org,41971,1690203972955 started 2023-07-24 13:06:15,202 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41971,1690203972955, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41971, sessionid=0x10197705e9f0001 2023-07-24 13:06:15,203 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 13:06:15,203 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 13:06:15,203 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 13:06:15,203 INFO [RS:2;jenkins-hbase4:37237] regionserver.Replication(203): jenkins-hbase4.apache.org,37237,1690203973072 started 2023-07-24 13:06:15,204 DEBUG [RS:1;jenkins-hbase4:43445] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:15,204 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37237,1690203973072, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37237, sessionid=0x10197705e9f0003 2023-07-24 13:06:15,203 DEBUG [RS:0;jenkins-hbase4:41971] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:15,204 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 13:06:15,204 DEBUG [RS:1;jenkins-hbase4:43445] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43445,1690203973024' 2023-07-24 13:06:15,205 DEBUG [RS:2;jenkins-hbase4:37237] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:15,205 DEBUG [RS:1;jenkins-hbase4:43445] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:15,204 DEBUG [RS:0;jenkins-hbase4:41971] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41971,1690203972955' 2023-07-24 13:06:15,205 DEBUG [RS:0;jenkins-hbase4:41971] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 13:06:15,205 DEBUG [RS:2;jenkins-hbase4:37237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37237,1690203973072' 2023-07-24 13:06:15,205 DEBUG [RS:2;jenkins-hbase4:37237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 13:06:15,206 DEBUG [RS:1;jenkins-hbase4:43445] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:15,206 DEBUG [RS:2;jenkins-hbase4:37237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 13:06:15,206 DEBUG [RS:0;jenkins-hbase4:41971] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 13:06:15,207 DEBUG [RS:1;jenkins-hbase4:43445] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 13:06:15,207 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 13:06:15,207 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 13:06:15,207 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 13:06:15,207 INFO [RS:1;jenkins-hbase4:43445] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 13:06:15,207 DEBUG [RS:2;jenkins-hbase4:37237] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:15,207 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 13:06:15,208 DEBUG [RS:0;jenkins-hbase4:41971] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:15,208 DEBUG [RS:0;jenkins-hbase4:41971] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41971,1690203972955' 2023-07-24 13:06:15,208 DEBUG [RS:0;jenkins-hbase4:41971] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:15,209 DEBUG [RS:0;jenkins-hbase4:41971] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:15,209 DEBUG [RS:0;jenkins-hbase4:41971] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 13:06:15,209 INFO [RS:0;jenkins-hbase4:41971] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 13:06:15,210 INFO [RS:0;jenkins-hbase4:41971] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 13:06:15,208 DEBUG [RS:2;jenkins-hbase4:37237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37237,1690203973072' 2023-07-24 13:06:15,210 DEBUG [RS:2;jenkins-hbase4:37237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:15,208 INFO [RS:1;jenkins-hbase4:43445] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 13:06:15,214 DEBUG [RS:2;jenkins-hbase4:37237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:15,215 DEBUG [RS:2;jenkins-hbase4:37237] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 13:06:15,215 INFO [RS:2;jenkins-hbase4:37237] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 13:06:15,215 INFO [RS:2;jenkins-hbase4:37237] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 13:06:15,298 DEBUG [jenkins-hbase4:39637] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 13:06:15,304 DEBUG [jenkins-hbase4:39637] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:15,325 INFO [RS:0;jenkins-hbase4:41971] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41971%2C1690203972955, suffix=, logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,41971,1690203972955, archiveDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs, maxLogs=32 2023-07-24 13:06:15,325 INFO [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43445%2C1690203973024, suffix=, logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,43445,1690203973024, archiveDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs, maxLogs=32 2023-07-24 13:06:15,328 DEBUG [jenkins-hbase4:39637] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:15,328 DEBUG [jenkins-hbase4:39637] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:15,328 DEBUG [jenkins-hbase4:39637] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:15,328 DEBUG [jenkins-hbase4:39637] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:15,331 INFO [RS:2;jenkins-hbase4:37237] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37237%2C1690203973072, suffix=, logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,37237,1690203973072, archiveDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs, maxLogs=32 2023-07-24 13:06:15,341 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43445,1690203973024, state=OPENING 2023-07-24 13:06:15,351 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 13:06:15,353 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:15,354 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 13:06:15,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:06:15,382 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK] 2023-07-24 13:06:15,419 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK] 2023-07-24 13:06:15,427 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK] 2023-07-24 13:06:15,427 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK] 2023-07-24 13:06:15,456 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK] 2023-07-24 13:06:15,456 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK] 2023-07-24 13:06:15,457 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK] 2023-07-24 13:06:15,457 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK] 2023-07-24 13:06:15,457 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK] 2023-07-24 13:06:15,496 INFO [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,43445,1690203973024/jenkins-hbase4.apache.org%2C43445%2C1690203973024.1690203975333 2023-07-24 13:06:15,497 DEBUG [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK], DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK], DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK]] 2023-07-24 13:06:15,498 INFO [RS:0;jenkins-hbase4:41971] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,41971,1690203972955/jenkins-hbase4.apache.org%2C41971%2C1690203972955.1690203975341 2023-07-24 13:06:15,498 INFO [RS:2;jenkins-hbase4:37237] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,37237,1690203973072/jenkins-hbase4.apache.org%2C37237%2C1690203973072.1690203975334 2023-07-24 13:06:15,500 DEBUG [RS:0;jenkins-hbase4:41971] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK], DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK], DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK]] 2023-07-24 13:06:15,500 DEBUG [RS:2;jenkins-hbase4:37237] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK], DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK], DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK]] 2023-07-24 13:06:15,668 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:15,671 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:06:15,676 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:06:15,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 13:06:15,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:15,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43445%2C1690203973024.meta, suffix=.meta, logDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,43445,1690203973024, archiveDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs, maxLogs=32 2023-07-24 13:06:15,727 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK] 2023-07-24 13:06:15,727 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK] 2023-07-24 13:06:15,727 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK] 2023-07-24 13:06:15,756 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/WALs/jenkins-hbase4.apache.org,43445,1690203973024/jenkins-hbase4.apache.org%2C43445%2C1690203973024.meta.1690203975702.meta 2023-07-24 13:06:15,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33145,DS-e283215c-099d-4b95-ba5e-08199c440494,DISK], DatanodeInfoWithStorage[127.0.0.1:33737,DS-2f6c6915-ca65-4dc4-ba52-2c60b8cdac5a,DISK], DatanodeInfoWithStorage[127.0.0.1:42413,DS-eb3e5822-79e5-4032-80a9-217cd2ef1f4d,DISK]] 2023-07-24 13:06:15,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:15,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 13:06:15,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:15,762 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 13:06:15,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 13:06:15,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 13:06:15,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 13:06:15,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:15,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 13:06:15,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 13:06:15,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 13:06:15,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/info 2023-07-24 13:06:15,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/info 2023-07-24 13:06:15,826 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 13:06:15,827 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,827 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 13:06:15,829 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/rep_barrier 2023-07-24 13:06:15,829 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/rep_barrier 2023-07-24 13:06:15,830 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 13:06:15,830 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,831 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 13:06:15,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/table 2023-07-24 13:06:15,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/table 2023-07-24 13:06:15,833 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 13:06:15,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,838 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740 2023-07-24 13:06:15,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740 2023-07-24 13:06:15,849 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 13:06:15,854 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 13:06:15,857 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61410174, jitterRate=-0.0849170982837677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 13:06:15,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 13:06:15,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690203975659 2023-07-24 13:06:15,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 13:06:15,899 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 13:06:15,900 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43445,1690203973024, state=OPEN 2023-07-24 13:06:15,903 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 13:06:15,904 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 13:06:15,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 13:06:15,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43445,1690203973024 in 545 msec 2023-07-24 13:06:15,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 13:06:15,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 822 msec 2023-07-24 13:06:15,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3390 sec 2023-07-24 13:06:15,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690203975928, completionTime=-1 2023-07-24 13:06:15,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 13:06:15,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 13:06:16,024 DEBUG [hconnection-0x5538a1e8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:16,028 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:16,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 13:06:16,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690204036054 2023-07-24 13:06:16,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690204096054 2023-07-24 13:06:16,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 125 msec 2023-07-24 13:06:16,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39637,1690203971407-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:16,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39637,1690203971407-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:16,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39637,1690203971407-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:16,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39637, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:16,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:16,117 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 13:06:16,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 13:06:16,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:16,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 13:06:16,138 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:16,143 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:16,167 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/namespace/084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,170 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/namespace/084d6909f3ca844c72efabe958826afe empty. 2023-07-24 13:06:16,171 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/namespace/084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,171 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 13:06:16,213 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:16,215 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 084d6909f3ca844c72efabe958826afe, NAME => 'hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:06:16,233 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:16,233 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 084d6909f3ca844c72efabe958826afe, disabling compactions & flushes 2023-07-24 13:06:16,233 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,233 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,234 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. after waiting 0 ms 2023-07-24 13:06:16,234 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,234 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,234 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 084d6909f3ca844c72efabe958826afe: 2023-07-24 13:06:16,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:16,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690203976242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203976242"}]},"ts":"1690203976242"} 2023-07-24 13:06:16,288 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 13:06:16,291 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:16,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203976291"}]},"ts":"1690203976291"} 2023-07-24 13:06:16,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 13:06:16,307 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:16,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:16,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:16,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:16,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:16,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=084d6909f3ca844c72efabe958826afe, ASSIGN}] 2023-07-24 13:06:16,314 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=084d6909f3ca844c72efabe958826afe, ASSIGN 2023-07-24 13:06:16,316 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=084d6909f3ca844c72efabe958826afe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41971,1690203972955; forceNewPlan=false, retain=false 2023-07-24 13:06:16,469 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 13:06:16,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=084d6909f3ca844c72efabe958826afe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:16,471 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690203976470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203976470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203976470"}]},"ts":"1690203976470"} 2023-07-24 13:06:16,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 084d6909f3ca844c72efabe958826afe, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:06:16,630 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:16,631 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:06:16,634 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:06:16,651 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 084d6909f3ca844c72efabe958826afe, NAME => 'hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:16,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. service=AccessControlService 2023-07-24 13:06:16,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:16,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:16,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,656 INFO [StoreOpener-084d6909f3ca844c72efabe958826afe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,659 DEBUG [StoreOpener-084d6909f3ca844c72efabe958826afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/info 2023-07-24 13:06:16,659 DEBUG [StoreOpener-084d6909f3ca844c72efabe958826afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/info 2023-07-24 13:06:16,659 INFO [StoreOpener-084d6909f3ca844c72efabe958826afe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 084d6909f3ca844c72efabe958826afe columnFamilyName info 2023-07-24 13:06:16,660 INFO [StoreOpener-084d6909f3ca844c72efabe958826afe-1] regionserver.HStore(310): Store=084d6909f3ca844c72efabe958826afe/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:16,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 084d6909f3ca844c72efabe958826afe 2023-07-24 13:06:16,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:16,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 084d6909f3ca844c72efabe958826afe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68904898, jitterRate=0.02676299214363098}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:16,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 084d6909f3ca844c72efabe958826afe: 2023-07-24 13:06:16,674 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe., pid=6, masterSystemTime=1690203976630 2023-07-24 13:06:16,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,679 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:06:16,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=084d6909f3ca844c72efabe958826afe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:16,681 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690203976680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203976680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203976680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203976680"}]},"ts":"1690203976680"} 2023-07-24 13:06:16,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 13:06:16,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 084d6909f3ca844c72efabe958826afe, server=jenkins-hbase4.apache.org,41971,1690203972955 in 210 msec 2023-07-24 13:06:16,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 13:06:16,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=084d6909f3ca844c72efabe958826afe, ASSIGN in 378 msec 2023-07-24 13:06:16,695 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:16,695 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203976695"}]},"ts":"1690203976695"} 2023-07-24 13:06:16,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 13:06:16,701 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:16,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 576 msec 2023-07-24 13:06:16,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 13:06:16,738 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 13:06:16,739 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:16,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:16,767 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:16,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 13:06:16,805 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 13:06:16,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-07-24 13:06:16,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 13:06:16,830 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 13:06:16,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-24 13:06:16,844 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 13:06:16,846 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 13:06:16,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.680sec 2023-07-24 13:06:16,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 13:06:16,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 13:06:16,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 13:06:16,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39637,1690203971407-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 13:06:16,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39637,1690203971407-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 13:06:16,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:16,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 13:06:16,883 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:16,887 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:16,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 13:06:16,890 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:16,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653 empty. 2023-07-24 13:06:16,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:16,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 13:06:16,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:16,925 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:16,930 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f5099410dc92ba494eaf33150e0b8653, NAME => 'hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:06:16,934 DEBUG [Listener at localhost/33675] zookeeper.ReadOnlyZKClient(139): Connect 0x0aad9b51 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:16,954 DEBUG [Listener at localhost/33675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ed5619, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:16,973 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:16,976 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f5099410dc92ba494eaf33150e0b8653, disabling compactions & flushes 2023-07-24 13:06:16,976 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:16,976 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:16,976 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. after waiting 0 ms 2023-07-24 13:06:16,976 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:16,976 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:16,976 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f5099410dc92ba494eaf33150e0b8653: 2023-07-24 13:06:16,983 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:16,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690203976984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203976984"}]},"ts":"1690203976984"} 2023-07-24 13:06:16,988 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 13:06:16,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:16,990 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203976990"}]},"ts":"1690203976990"} 2023-07-24 13:06:16,993 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 13:06:16,995 DEBUG [hconnection-0x40158772-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:16,998 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:16,999 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:17,000 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:17,000 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:17,000 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:17,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f5099410dc92ba494eaf33150e0b8653, ASSIGN}] 2023-07-24 13:06:17,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:17,005 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f5099410dc92ba494eaf33150e0b8653, ASSIGN 2023-07-24 13:06:17,008 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f5099410dc92ba494eaf33150e0b8653, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41971,1690203972955; forceNewPlan=false, retain=false 2023-07-24 13:06:17,011 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/test.cache.data in system properties and HBase conf 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop.log.dir in system properties and HBase conf 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 13:06:17,015 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/nfs.dump.dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 13:06:17,016 INFO [Listener at localhost/33675] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 13:06:17,159 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 13:06:17,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f5099410dc92ba494eaf33150e0b8653, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:17,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690203977160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203977160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203977160"}]},"ts":"1690203977160"} 2023-07-24 13:06:17,166 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f5099410dc92ba494eaf33150e0b8653, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:06:17,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:17,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:17,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5099410dc92ba494eaf33150e0b8653, NAME => 'hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:17,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. service=AccessControlService 2023-07-24 13:06:17,332 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:17,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:17,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,337 INFO [StoreOpener-f5099410dc92ba494eaf33150e0b8653-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,344 DEBUG [StoreOpener-f5099410dc92ba494eaf33150e0b8653-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/l 2023-07-24 13:06:17,344 DEBUG [StoreOpener-f5099410dc92ba494eaf33150e0b8653-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/l 2023-07-24 13:06:17,344 INFO [StoreOpener-f5099410dc92ba494eaf33150e0b8653-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5099410dc92ba494eaf33150e0b8653 columnFamilyName l 2023-07-24 13:06:17,347 INFO [StoreOpener-f5099410dc92ba494eaf33150e0b8653-1] regionserver.HStore(310): Store=f5099410dc92ba494eaf33150e0b8653/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:17,350 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:06:17,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:17,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f5099410dc92ba494eaf33150e0b8653; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69878487, jitterRate=0.04127059876918793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:17,386 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f5099410dc92ba494eaf33150e0b8653: 2023-07-24 13:06:17,388 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653., pid=11, masterSystemTime=1690203977322 2023-07-24 13:06:17,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:17,392 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:06:17,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f5099410dc92ba494eaf33150e0b8653, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:17,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690203977393"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203977393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203977393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203977393"}]},"ts":"1690203977393"} 2023-07-24 13:06:17,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 13:06:17,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f5099410dc92ba494eaf33150e0b8653, server=jenkins-hbase4.apache.org,41971,1690203972955 in 232 msec 2023-07-24 13:06:17,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 13:06:17,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f5099410dc92ba494eaf33150e0b8653, ASSIGN in 403 msec 2023-07-24 13:06:17,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:17,416 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203977416"}]},"ts":"1690203977416"} 2023-07-24 13:06:17,419 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 13:06:17,424 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:17,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 545 msec 2023-07-24 13:06:17,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:17,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 13:06:17,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 13:06:18,479 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:18,876 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:18,883 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34617_jobhistory____hnuj7o/webapp 2023-07-24 13:06:19,088 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 13:06:19,089 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:19,089 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:19,092 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:19,184 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:19,563 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:20,134 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 13:06:20,202 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34617 2023-07-24 13:06:21,412 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:06:21,666 WARN [Listener at jenkins-hbase4.apache.org/43113] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:21,695 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 13:06:21,696 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 13:06:21,698 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 13:06:21,700 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:21,700 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 13:06:21,701 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:21,701 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 13:06:21,701 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 13:06:21,701 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 13:06:21,701 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:21,702 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 13:06:21,702 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 13:06:21,702 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 13:06:21,775 WARN [Listener at jenkins-hbase4.apache.org/43113] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 13:06:21,776 INFO [Listener at jenkins-hbase4.apache.org/43113] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:21,786 INFO [Listener at jenkins-hbase4.apache.org/43113] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37503_cluster____.rnfai8/webapp 2023-07-24 13:06:21,873 INFO [Listener at jenkins-hbase4.apache.org/43113] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:21,873 INFO [Listener at jenkins-hbase4.apache.org/43113] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 13:06:21,873 INFO [Listener at jenkins-hbase4.apache.org/43113] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:21,874 INFO [Listener at jenkins-hbase4.apache.org/43113] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:21,887 INFO [Listener at jenkins-hbase4.apache.org/43113] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,104 INFO [Listener at jenkins-hbase4.apache.org/43113] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,214 INFO [Listener at jenkins-hbase4.apache.org/43113] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,223 INFO [Listener at jenkins-hbase4.apache.org/43113] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37503 2023-07-24 13:06:22,719 WARN [Listener at jenkins-hbase4.apache.org/45895] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:22,746 WARN [Listener at jenkins-hbase4.apache.org/45895] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 13:06:22,747 INFO [Listener at jenkins-hbase4.apache.org/45895] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:22,756 INFO [Listener at jenkins-hbase4.apache.org/45895] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39437_node____h62g8g/webapp 2023-07-24 13:06:22,839 INFO [Listener at jenkins-hbase4.apache.org/45895] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 13:06:22,840 INFO [Listener at jenkins-hbase4.apache.org/45895] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:22,840 INFO [Listener at jenkins-hbase4.apache.org/45895] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:22,840 INFO [Listener at jenkins-hbase4.apache.org/45895] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:22,859 INFO [Listener at jenkins-hbase4.apache.org/45895] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,888 INFO [Listener at jenkins-hbase4.apache.org/45895] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,001 INFO [Listener at jenkins-hbase4.apache.org/45895] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,026 INFO [Listener at jenkins-hbase4.apache.org/45895] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39437 2023-07-24 13:06:23,265 WARN [Listener at jenkins-hbase4.apache.org/44893] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:23,272 WARN [Listener at jenkins-hbase4.apache.org/44893] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 13:06:23,272 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:23,280 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33887_node____baqyvp/webapp 2023-07-24 13:06:23,351 INFO [Listener at jenkins-hbase4.apache.org/44893] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 13:06:23,351 INFO [Listener at jenkins-hbase4.apache.org/44893] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:23,352 INFO [Listener at jenkins-hbase4.apache.org/44893] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:23,352 INFO [Listener at jenkins-hbase4.apache.org/44893] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:23,362 INFO [Listener at jenkins-hbase4.apache.org/44893] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,380 INFO [Listener at jenkins-hbase4.apache.org/44893] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,515 INFO [Listener at jenkins-hbase4.apache.org/44893] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,523 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33887 2023-07-24 13:06:23,563 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 13:06:23,565 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:23,652 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=172, AvailableMemoryMB=7762 2023-07-24 13:06:23,653 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-24 13:06:23,675 DEBUG [Listener at jenkins-hbase4.apache.org/44893] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 13:06:23,682 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 13:06:23,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 13:06:23,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:23,698 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:23,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 13:06:23,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:23,704 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:23,709 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:23,709 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:23,711 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 empty. 2023-07-24 13:06:23,711 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f empty. 2023-07-24 13:06:23,713 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:23,713 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:23,713 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 13:06:23,750 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:23,753 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 37b3eec2f822293b406109713e7d824f, NAME => 'testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:06:23,753 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => db652867f114de6b5074417ec82c7ef6, NAME => 'testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:06:23,790 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:23,790 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 37b3eec2f822293b406109713e7d824f, disabling compactions & flushes 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing db652867f114de6b5074417ec82c7ef6, disabling compactions & flushes 2023-07-24 13:06:23,793 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:23,793 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. after waiting 0 ms 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. after waiting 0 ms 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:23,793 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:23,793 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for db652867f114de6b5074417ec82c7ef6: 2023-07-24 13:06:23,793 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 37b3eec2f822293b406109713e7d824f: 2023-07-24 13:06:23,800 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:23,801 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203983801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203983801"}]},"ts":"1690203983801"} 2023-07-24 13:06:23,802 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203983801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203983801"}]},"ts":"1690203983801"} 2023-07-24 13:06:23,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:23,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:06:23,853 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:23,853 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203983853"}]},"ts":"1690203983853"} 2023-07-24 13:06:23,855 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 13:06:23,862 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:23,864 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:23,864 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:23,864 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:23,864 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:23,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, ASSIGN}] 2023-07-24 13:06:23,867 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, ASSIGN 2023-07-24 13:06:23,867 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, ASSIGN 2023-07-24 13:06:23,868 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41971,1690203972955; forceNewPlan=false, retain=false 2023-07-24 13:06:23,868 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:06:24,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:24,018 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:06:24,021 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=db652867f114de6b5074417ec82c7ef6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:24,021 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=37b3eec2f822293b406109713e7d824f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:24,021 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203984021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203984021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203984021"}]},"ts":"1690203984021"} 2023-07-24 13:06:24,021 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203984021"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203984021"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203984021"}]},"ts":"1690203984021"} 2023-07-24 13:06:24,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure db652867f114de6b5074417ec82c7ef6, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:06:24,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 37b3eec2f822293b406109713e7d824f, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:06:24,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37b3eec2f822293b406109713e7d824f, NAME => 'testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:06:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. service=AccessControlService 2023-07-24 13:06:24,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db652867f114de6b5074417ec82c7ef6, NAME => 'testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:06:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. service=AccessControlService 2023-07-24 13:06:24,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,195 INFO [StoreOpener-db652867f114de6b5074417ec82c7ef6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,195 INFO [StoreOpener-37b3eec2f822293b406109713e7d824f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,197 DEBUG [StoreOpener-db652867f114de6b5074417ec82c7ef6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf 2023-07-24 13:06:24,197 DEBUG [StoreOpener-db652867f114de6b5074417ec82c7ef6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf 2023-07-24 13:06:24,197 DEBUG [StoreOpener-37b3eec2f822293b406109713e7d824f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf 2023-07-24 13:06:24,198 DEBUG [StoreOpener-37b3eec2f822293b406109713e7d824f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf 2023-07-24 13:06:24,202 INFO [StoreOpener-db652867f114de6b5074417ec82c7ef6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db652867f114de6b5074417ec82c7ef6 columnFamilyName cf 2023-07-24 13:06:24,202 INFO [StoreOpener-37b3eec2f822293b406109713e7d824f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37b3eec2f822293b406109713e7d824f columnFamilyName cf 2023-07-24 13:06:24,205 INFO [StoreOpener-37b3eec2f822293b406109713e7d824f-1] regionserver.HStore(310): Store=37b3eec2f822293b406109713e7d824f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:24,206 INFO [StoreOpener-db652867f114de6b5074417ec82c7ef6-1] regionserver.HStore(310): Store=db652867f114de6b5074417ec82c7ef6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:24,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:24,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:24,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:24,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db652867f114de6b5074417ec82c7ef6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71574209, jitterRate=0.06653882563114166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:24,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db652867f114de6b5074417ec82c7ef6: 2023-07-24 13:06:24,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:24,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6., pid=15, masterSystemTime=1690203984176 2023-07-24 13:06:24,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 37b3eec2f822293b406109713e7d824f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74080969, jitterRate=0.10389246046543121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:24,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 37b3eec2f822293b406109713e7d824f: 2023-07-24 13:06:24,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f., pid=16, masterSystemTime=1690203984177 2023-07-24 13:06:24,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:24,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:24,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=db652867f114de6b5074417ec82c7ef6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:24,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203984236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203984236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203984236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203984236"}]},"ts":"1690203984236"} 2023-07-24 13:06:24,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:24,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:24,238 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=37b3eec2f822293b406109713e7d824f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:24,241 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203984238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203984238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203984238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203984238"}]},"ts":"1690203984238"} 2023-07-24 13:06:24,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 13:06:24,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure db652867f114de6b5074417ec82c7ef6, server=jenkins-hbase4.apache.org,41971,1690203972955 in 219 msec 2023-07-24 13:06:24,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 13:06:24,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 37b3eec2f822293b406109713e7d824f, server=jenkins-hbase4.apache.org,43445,1690203973024 in 219 msec 2023-07-24 13:06:24,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, ASSIGN in 382 msec 2023-07-24 13:06:24,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-24 13:06:24,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, ASSIGN in 388 msec 2023-07-24 13:06:24,260 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:24,260 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203984260"}]},"ts":"1690203984260"} 2023-07-24 13:06:24,263 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 13:06:24,266 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:24,272 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 13:06:24,283 DEBUG [hconnection-0x1658aad6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,287 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,298 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 13:06:24,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:24,337 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,337 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,337 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,337 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,337 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:24,348 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:24,348 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:24,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,349 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,350 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,350 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,354 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 659 msec 2023-07-24 13:06:24,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:24,811 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 13:06:24,816 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 13:06:24,817 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:24,820 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:24,846 DEBUG [hconnection-0x40158772-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,849 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:24,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690203984871 (current time:1690203984872). 2023-07-24 13:06:24,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:24,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x6b6e76a6 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:24,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b08342f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:24,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,888 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b6e76a6 to 127.0.0.1:63130 2023-07-24 13:06:24,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:24,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x472abd63 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:24,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e5c6de4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:24,912 DEBUG [hconnection-0x3d22b7d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,913 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,923 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x472abd63 to 127.0.0.1:63130 2023-07-24 13:06:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 13:06:24,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:24,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:24,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:24,984 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:24,985 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690204584985 2023-07-24 13:06:24,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:24,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 13:06:24,989 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:24,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:24,994 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:24,994 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:25,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-24 13:06:25,003 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,005 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690204585005 2023-07-24 13:06:25,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,053 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 13:06:25,053 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,054 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 13:06:25,054 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 13:06:25,055 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,055 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,060 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,061 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,061 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,061 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,061 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:25,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,067 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,067 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,067 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,067 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,067 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,068 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,067 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,069 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,070 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,070 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,070 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,070 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,070 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,070 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,073 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,073 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,074 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,074 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,074 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,074 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,074 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,075 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,075 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,075 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,075 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:25,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b27fdc8[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:25,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b27fdc8[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:25,091 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 13:06:25,091 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,095 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,097 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,097 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,097 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,097 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,097 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:06:25,097 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,097 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,098 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,099 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:25,099 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,099 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:25,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:25,100 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:25,100 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:25,101 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. started... 2023-07-24 13:06:25,102 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:25,102 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. started... 2023-07-24 13:06:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,102 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:25,103 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:25,108 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db652867f114de6b5074417ec82c7ef6: 2023-07-24 13:06:25,108 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37b3eec2f822293b406109713e7d824f: 2023-07-24 13:06:25,109 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,109 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,116 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:25,116 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:25,120 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:25,120 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:25,159 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. completed. 2023-07-24 13:06:25,159 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:25,161 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:25,161 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:25,161 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,163 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:06:25,165 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,165 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. completed. 2023-07-24 13:06:25,165 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:06:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,169 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41971,1690203972955': 2023-07-24 13:06:25,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 13:06:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:06:25,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 13:06:25,183 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 13:06:25,183 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:25,183 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:25,183 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,183 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:25,187 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,188 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,188 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,188 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,189 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,190 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,191 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,192 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,194 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,195 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,195 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,210 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,210 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,210 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,215 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,215 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,215 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,215 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,215 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,215 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,216 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 13:06:25,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,218 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 13:06:25,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,303 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:25,305 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:06:25,337 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 13:06:25,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,338 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690203984986Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690203985246 (+260 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690203985246Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690203985246Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690203985263 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690203985292 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690203985337 (+45 ms) 2023-07-24 13:06:25,339 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 352 msec 2023-07-24 13:06:25,606 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:25,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41971] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:25,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:25,631 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 13:06:25,632 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:25,632 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:25,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690203985648 (current time:1690203985648). 2023-07-24 13:06:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x24137105 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6862ec73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:25,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,663 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24137105 to 127.0.0.1:63130 2023-07-24 13:06:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:25,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x2200aaef to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:25,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d247cf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:25,674 DEBUG [hconnection-0x62da0a50-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,677 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,684 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2200aaef to 127.0.0.1:63130 2023-07-24 13:06:25,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:25,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 13:06:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:25,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:25,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:25,691 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:25,693 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690204585693 2023-07-24 13:06:25,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:25,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 13:06:25,694 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:25,694 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:25,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,696 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:25,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-24 13:06:25,698 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,699 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690204585699 2023-07-24 13:06:25,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 13:06:25,718 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 13:06:25,718 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,719 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 13:06:25,719 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 13:06:25,720 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,720 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,721 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,721 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,721 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,721 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,722 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,722 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,722 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,722 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:25,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 13:06:25,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,723 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 13:06:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 13:06:25,724 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,724 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,725 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,725 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,725 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,725 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,728 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,728 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,728 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,728 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,728 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,730 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,732 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,732 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4efa61c9[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:25,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4efa61c9[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:25,737 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 13:06:25,737 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,741 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,741 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,741 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,742 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,742 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:25,742 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. started... 2023-07-24 13:06:25,742 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:25,742 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:25,742 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:25,743 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 37b3eec2f822293b406109713e7d824f 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 13:06:25,742 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:06:25,743 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:25,742 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. started... 2023-07-24 13:06:25,743 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2745): Flushing db652867f114de6b5074417ec82c7ef6 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 13:06:25,745 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,746 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,746 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,795 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:25,802 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:25,941 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072414ea1d08c8bc41cf8266e36429b2e90c to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072414ea1d08c8bc41cf8266e36429b2e90c 2023-07-24 13:06:25,941 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724f67c35216a3a4c50b6bd07d96e593371 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724f67c35216a3a4c50b6bd07d96e593371 2023-07-24 13:06:25,986 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/.tmp/cf/870ce493c8674795843460e3ddbfa14d 2023-07-24 13:06:25,986 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/.tmp/cf/baf6880c60074e13bdd452b2c0625004 2023-07-24 13:06:25,999 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/.tmp/cf/870ce493c8674795843460e3ddbfa14d as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf/870ce493c8674795843460e3ddbfa14d 2023-07-24 13:06:26,000 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/.tmp/cf/baf6880c60074e13bdd452b2c0625004 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf/baf6880c60074e13bdd452b2c0625004 2023-07-24 13:06:26,002 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:26,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:26,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:26,007 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:06:26,013 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf/870ce493c8674795843460e3ddbfa14d, entries=46, sequenceid=6, filesize=12.6 K 2023-07-24 13:06:26,013 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf/baf6880c60074e13bdd452b2c0625004, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 13:06:26,017 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for db652867f114de6b5074417ec82c7ef6 in 274ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:26,017 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 37b3eec2f822293b406109713e7d824f in 275ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:26,017 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 13:06:26,017 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 13:06:26,022 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37b3eec2f822293b406109713e7d824f: 2023-07-24 13:06:26,022 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db652867f114de6b5074417ec82c7ef6: 2023-07-24 13:06:26,023 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:26,023 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:26,023 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:26,023 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:26,023 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf/baf6880c60074e13bdd452b2c0625004] hfiles 2023-07-24 13:06:26,023 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf/870ce493c8674795843460e3ddbfa14d] hfiles 2023-07-24 13:06:26,024 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf/baf6880c60074e13bdd452b2c0625004 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:26,024 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf/870ce493c8674795843460e3ddbfa14d for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:26,063 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. completed. 2023-07-24 13:06:26,063 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:26,063 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:26,063 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:26,063 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,063 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:26,063 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:06:26,065 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,065 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:26,065 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:26,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,065 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:26,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:26,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:26,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:26,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:26,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:26,073 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. completed. 2023-07-24 13:06:26,073 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:26,073 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:26,073 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:26,073 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,074 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:26,074 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:06:26,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,076 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:26,076 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,076 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:26,076 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:26,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:26,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41971,1690203972955': 2023-07-24 13:06:26,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 13:06:26,082 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 13:06:26,082 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:26,082 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:26,082 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 13:06:26,082 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:26,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:26,084 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,085 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:26,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:26,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:26,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,086 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,086 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:26,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:26,089 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:26,089 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,090 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:26,100 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:26,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:26,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:26,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:26,101 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 13:06:26,100 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:26,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:26,101 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:06:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:26,101 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:26,101 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:26,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:26,101 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:26,102 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,102 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:26,102 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:26,102 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:26,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:26,102 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:26,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:26,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724f67c35216a3a4c50b6bd07d96e593371, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072414ea1d08c8bc41cf8266e36429b2e90c] mob files 2023-07-24 13:06:26,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724f67c35216a3a4c50b6bd07d96e593371 2023-07-24 13:06:26,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072414ea1d08c8bc41cf8266e36429b2e90c 2023-07-24 13:06:26,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 13:06:26,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 13:06:26,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,194 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690203985693Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690203986116 (+423 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690203986116Loading Region manifests for snaptb0-testExportWithTargetName at 1690203986116Writing data manifest for snaptb0-testExportWithTargetName at 1690203986123 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690203986144 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690203986193 (+49 ms) 2023-07-24 13:06:26,195 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:26,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 502 msec 2023-07-24 13:06:26,307 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:26,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:26,312 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312 2023-07-24 13:06:26,312 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37143, tgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312, rawTgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:26,380 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_75207648_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 13:06:26,380 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 13:06:26,431 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 13:06:26,543 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:26,544 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:26,545 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:26,545 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,611 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-2578797866980452344.jar 2023-07-24 13:06:27,612 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,612 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,683 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-6619994948690693695.jar 2023-07-24 13:06:27,684 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,684 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,685 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,685 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,685 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,686 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,686 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:06:27,687 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:06:27,687 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:06:27,688 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:06:27,688 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:06:27,689 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:06:27,689 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:06:27,690 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:06:27,690 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:06:27,691 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:06:27,695 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,696 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,696 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:27,696 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,697 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,697 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:27,698 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:29,037 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:06:29,042 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 13:06:29,052 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 13:06:29,605 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:29,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:29,729 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:06:30,356 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:35,846 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:38,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:41,521 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:43,095 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:06:43,098 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:06:43,109 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 13:06:43,110 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:06:43,110 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:06:43,111 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 13:06:43,111 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 13:06:43,112 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 13:06:43,112 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312/.hbase-snapshot/testExportWithTargetName 2023-07-24 13:06:43,112 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 13:06:43,112 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690203986312/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 13:06:43,124 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 13:06:43,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 13:06:43,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,145 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204003145"}]},"ts":"1690204003145"} 2023-07-24 13:06:43,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 13:06:43,149 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 13:06:43,151 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 13:06:43,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, UNASSIGN}] 2023-07-24 13:06:43,157 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, UNASSIGN 2023-07-24 13:06:43,157 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, UNASSIGN 2023-07-24 13:06:43,158 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=db652867f114de6b5074417ec82c7ef6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:43,158 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=37b3eec2f822293b406109713e7d824f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:43,158 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204003158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204003158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204003158"}]},"ts":"1690204003158"} 2023-07-24 13:06:43,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204003158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204003158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204003158"}]},"ts":"1690204003158"} 2023-07-24 13:06:43,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure db652867f114de6b5074417ec82c7ef6, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:06:43,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 37b3eec2f822293b406109713e7d824f, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:06:43,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 13:06:43,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:43,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db652867f114de6b5074417ec82c7ef6, disabling compactions & flushes 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 37b3eec2f822293b406109713e7d824f, disabling compactions & flushes 2023-07-24 13:06:43,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:43,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. after waiting 0 ms 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. after waiting 0 ms 2023-07-24 13:06:43,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:43,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:43,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:06:43,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:06:43,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:43,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:43,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f. 2023-07-24 13:06:43,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 37b3eec2f822293b406109713e7d824f: 2023-07-24 13:06:43,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6. 2023-07-24 13:06:43,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db652867f114de6b5074417ec82c7ef6: 2023-07-24 13:06:43,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:43,356 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=37b3eec2f822293b406109713e7d824f, regionState=CLOSED 2023-07-24 13:06:43,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:43,357 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204003356"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204003356"}]},"ts":"1690204003356"} 2023-07-24 13:06:43,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=db652867f114de6b5074417ec82c7ef6, regionState=CLOSED 2023-07-24 13:06:43,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204003358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204003358"}]},"ts":"1690204003358"} 2023-07-24 13:06:43,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 13:06:43,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 37b3eec2f822293b406109713e7d824f, server=jenkins-hbase4.apache.org,43445,1690203973024 in 196 msec 2023-07-24 13:06:43,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 13:06:43,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure db652867f114de6b5074417ec82c7ef6, server=jenkins-hbase4.apache.org,41971,1690203972955 in 198 msec 2023-07-24 13:06:43,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=37b3eec2f822293b406109713e7d824f, UNASSIGN in 210 msec 2023-07-24 13:06:43,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 13:06:43,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=db652867f114de6b5074417ec82c7ef6, UNASSIGN in 211 msec 2023-07-24 13:06:43,369 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204003369"}]},"ts":"1690204003369"} 2023-07-24 13:06:43,372 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 13:06:43,374 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 13:06:43,378 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 242 msec 2023-07-24 13:06:43,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 13:06:43,450 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 13:06:43,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 13:06:43,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,467 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 13:06:43,469 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,473 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 13:06:43,476 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:43,477 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:43,477 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:43,477 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:43,477 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:43,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 13:06:43,478 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 13:06:43,479 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:43,480 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:43,480 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,480 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,480 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 13:06:43,481 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 13:06:43,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 13:06:43,481 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 13:06:43,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:43,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,482 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/recovered.edits] 2023-07-24 13:06:43,482 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/recovered.edits] 2023-07-24 13:06:43,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 13:06:43,496 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf/baf6880c60074e13bdd452b2c0625004 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/cf/baf6880c60074e13bdd452b2c0625004 2023-07-24 13:06:43,496 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf/870ce493c8674795843460e3ddbfa14d to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/cf/870ce493c8674795843460e3ddbfa14d 2023-07-24 13:06:43,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f/recovered.edits/9.seqid 2023-07-24 13:06:43,501 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6/recovered.edits/9.seqid 2023-07-24 13:06:43,502 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/37b3eec2f822293b406109713e7d824f 2023-07-24 13:06:43,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportWithTargetName/db652867f114de6b5074417ec82c7ef6 2023-07-24 13:06:43,502 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 13:06:43,503 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 13:06:43,504 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 13:06:43,509 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724f67c35216a3a4c50b6bd07d96e593371 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230724f67c35216a3a4c50b6bd07d96e593371 2023-07-24 13:06:43,510 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072414ea1d08c8bc41cf8266e36429b2e90c to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072414ea1d08c8bc41cf8266e36429b2e90c 2023-07-24 13:06:43,511 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 13:06:43,514 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,539 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 13:06:43,542 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 13:06:43,544 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,544 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 13:06:43,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204003544"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:43,545 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204003544"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:43,547 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:06:43,547 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => db652867f114de6b5074417ec82c7ef6, NAME => 'testtb-testExportWithTargetName,,1690203983689.db652867f114de6b5074417ec82c7ef6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 37b3eec2f822293b406109713e7d824f, NAME => 'testtb-testExportWithTargetName,1,1690203983689.37b3eec2f822293b406109713e7d824f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:06:43,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 13:06:43,547 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204003547"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:43,549 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 13:06:43,552 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:43,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 94 msec 2023-07-24 13:06:43,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 13:06:43,596 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 13:06:43,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 13:06:43,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:43,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 13:06:43,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 13:06:43,672 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 705) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:44098 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:36723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1086622645_1 at /127.0.0.1:41674 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-64834910_17 at /127.0.0.1:48298 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:34987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:41706 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 160) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6128 (was 7762) 2023-07-24 13:06:43,673 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-24 13:06:43,700 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=179, AvailableMemoryMB=6128 2023-07-24 13:06:43,700 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-24 13:06:43,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 13:06:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:43,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:43,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 13:06:43,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:43,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:43,718 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:43,718 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:43,719 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 empty. 2023-07-24 13:06:43,719 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 empty. 2023-07-24 13:06:43,719 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:43,719 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:43,720 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 13:06:43,753 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:43,754 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a3fc27741ade07f9bb1614316a2e752, NAME => 'testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:06:43,765 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 322da94f38ad1f6274154d395ef98121, NAME => 'testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:06:43,805 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:43,806 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7a3fc27741ade07f9bb1614316a2e752, disabling compactions & flushes 2023-07-24 13:06:43,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:43,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:43,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. after waiting 0 ms 2023-07-24 13:06:43,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:43,807 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:43,807 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7a3fc27741ade07f9bb1614316a2e752: 2023-07-24 13:06:43,808 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:43,809 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 322da94f38ad1f6274154d395ef98121, disabling compactions & flushes 2023-07-24 13:06:43,809 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:43,809 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:43,809 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. after waiting 0 ms 2023-07-24 13:06:43,809 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:43,809 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:43,809 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 322da94f38ad1f6274154d395ef98121: 2023-07-24 13:06:43,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:43,814 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204003813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204003813"}]},"ts":"1690204003813"} 2023-07-24 13:06:43,814 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204003813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204003813"}]},"ts":"1690204003813"} 2023-07-24 13:06:43,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:43,817 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:06:43,818 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:43,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204003818"}]},"ts":"1690204003818"} 2023-07-24 13:06:43,820 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 13:06:43,824 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:43,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:43,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:43,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:43,825 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:43,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, ASSIGN}] 2023-07-24 13:06:43,829 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, ASSIGN 2023-07-24 13:06:43,829 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, ASSIGN 2023-07-24 13:06:43,832 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37237,1690203973072; forceNewPlan=false, retain=false 2023-07-24 13:06:43,832 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41971,1690203972955; forceNewPlan=false, retain=false 2023-07-24 13:06:43,982 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:06:43,985 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7a3fc27741ade07f9bb1614316a2e752, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:43,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=322da94f38ad1f6274154d395ef98121, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:43,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204003985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204003985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204003985"}]},"ts":"1690204003985"} 2023-07-24 13:06:43,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204003985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204003985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204003985"}]},"ts":"1690204003985"} 2023-07-24 13:06:43,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 7a3fc27741ade07f9bb1614316a2e752, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:06:43,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 322da94f38ad1f6274154d395ef98121, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:06:44,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:44,143 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,143 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:06:44,147 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:06:44,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 322da94f38ad1f6274154d395ef98121, NAME => 'testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:06:44,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. service=AccessControlService 2023-07-24 13:06:44,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:44,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:44,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,155 INFO [StoreOpener-322da94f38ad1f6274154d395ef98121-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a3fc27741ade07f9bb1614316a2e752, NAME => 'testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:06:44,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. service=AccessControlService 2023-07-24 13:06:44,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:44,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:44,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,157 DEBUG [StoreOpener-322da94f38ad1f6274154d395ef98121-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf 2023-07-24 13:06:44,157 DEBUG [StoreOpener-322da94f38ad1f6274154d395ef98121-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf 2023-07-24 13:06:44,158 INFO [StoreOpener-322da94f38ad1f6274154d395ef98121-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 322da94f38ad1f6274154d395ef98121 columnFamilyName cf 2023-07-24 13:06:44,158 INFO [StoreOpener-7a3fc27741ade07f9bb1614316a2e752-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,159 INFO [StoreOpener-322da94f38ad1f6274154d395ef98121-1] regionserver.HStore(310): Store=322da94f38ad1f6274154d395ef98121/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:44,161 DEBUG [StoreOpener-7a3fc27741ade07f9bb1614316a2e752-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf 2023-07-24 13:06:44,161 DEBUG [StoreOpener-7a3fc27741ade07f9bb1614316a2e752-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf 2023-07-24 13:06:44,161 INFO [StoreOpener-7a3fc27741ade07f9bb1614316a2e752-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a3fc27741ade07f9bb1614316a2e752 columnFamilyName cf 2023-07-24 13:06:44,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,163 INFO [StoreOpener-7a3fc27741ade07f9bb1614316a2e752-1] regionserver.HStore(310): Store=7a3fc27741ade07f9bb1614316a2e752/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:44,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 322da94f38ad1f6274154d395ef98121 2023-07-24 13:06:44,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:06:44,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:44,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 322da94f38ad1f6274154d395ef98121; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63247101, jitterRate=-0.05754475295543671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:44,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 322da94f38ad1f6274154d395ef98121: 2023-07-24 13:06:44,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121., pid=31, masterSystemTime=1690204004143 2023-07-24 13:06:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:44,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a3fc27741ade07f9bb1614316a2e752; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66347695, jitterRate=-0.011342301964759827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:44,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a3fc27741ade07f9bb1614316a2e752: 2023-07-24 13:06:44,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752., pid=30, masterSystemTime=1690204004143 2023-07-24 13:06:44,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,179 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=322da94f38ad1f6274154d395ef98121, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,180 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204004179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204004179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204004179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204004179"}]},"ts":"1690204004179"} 2023-07-24 13:06:44,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,182 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7a3fc27741ade07f9bb1614316a2e752, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204004182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204004182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204004182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204004182"}]},"ts":"1690204004182"} 2023-07-24 13:06:44,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 13:06:44,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 322da94f38ad1f6274154d395ef98121, server=jenkins-hbase4.apache.org,41971,1690203972955 in 193 msec 2023-07-24 13:06:44,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 13:06:44,197 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:44,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 7a3fc27741ade07f9bb1614316a2e752, server=jenkins-hbase4.apache.org,37237,1690203973072 in 197 msec 2023-07-24 13:06:44,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 13:06:44,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, ASSIGN in 367 msec 2023-07-24 13:06:44,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, ASSIGN in 369 msec 2023-07-24 13:06:44,211 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204004210"}]},"ts":"1690204004210"} 2023-07-24 13:06:44,213 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 13:06:44,217 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:44,218 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 13:06:44,220 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:06:44,222 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:44,222 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:44,222 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:44,222 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:44,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:44,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:44,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:44,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:44,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 519 msec 2023-07-24 13:06:44,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:44,324 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 13:06:44,327 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 13:06:44,327 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,330 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:44,340 DEBUG [hconnection-0x40158772-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,346 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:44,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204004353 (current time:1690204004353). 2023-07-24 13:06:44,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:44,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x088f98f1 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:44,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f9bac95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:44,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,363 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x088f98f1 to 127.0.0.1:63130 2023-07-24 13:06:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:44,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x2873b892 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ccff57d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:44,374 DEBUG [hconnection-0xe620575-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,378 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,384 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2873b892 to 127.0.0.1:63130 2023-07-24 13:06:44,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:44,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:06:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:44,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:44,391 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:44,392 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204604392 2023-07-24 13:06:44,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:44,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 13:06:44,394 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:44,394 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:44,396 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:44,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:44,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 13:06:44,400 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:44,405 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204604405 2023-07-24 13:06:44,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,421 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 13:06:44,421 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,423 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 13:06:44,423 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:06:44,424 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,424 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,425 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,425 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,425 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,425 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,426 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,426 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,426 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,426 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:44,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:44,427 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:44,427 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:44,429 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,439 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,439 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:44,439 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:44,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:44,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7745aa76[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:44,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7745aa76[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:44,444 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:06:44,444 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:44,446 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:06:44,446 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,446 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. started... 2023-07-24 13:06:44,446 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,446 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:44,448 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:44,448 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 322da94f38ad1f6274154d395ef98121: 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. started... 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a3fc27741ade07f9bb1614316a2e752: 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,448 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:44,449 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:44,466 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. completed. 2023-07-24 13:06:44,466 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,467 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:44,467 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:44,467 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,467 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:44,467 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:06:44,468 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. completed. 2023-07-24 13:06:44,468 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,468 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:44,468 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:44,468 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,468 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:44,468 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:06:44,470 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:44,471 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41971,1690203972955': 2023-07-24 13:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:06:44,479 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 13:06:44,479 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:44,479 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:44,479 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,479 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:44,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,482 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,481 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,482 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,482 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,483 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,485 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,485 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,486 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,493 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,493 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 13:06:44,494 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,492 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,494 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:06:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,494 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,494 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,495 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:44,494 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,495 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 13:06:44,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:44,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:44,496 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:44,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 13:06:44,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,565 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:44,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690204004393Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690204004506 (+113 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690204004506Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690204004507 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690204004511 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690204004530 (+19 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690204004565 (+35 ms) 2023-07-24 13:06:44,568 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:44,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 174 msec 2023-07-24 13:06:44,696 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:44,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:44,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:44,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37237] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:44,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41971] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:44,708 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 13:06:44,708 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,709 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:44,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:44,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204004722 (current time:1690204004722). 2023-07-24 13:06:44,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:44,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x5ca6ff52 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:44,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ffc5e7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:44,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,736 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ca6ff52 to 127.0.0.1:63130 2023-07-24 13:06:44,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:44,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x37096ca2 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:44,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c3e497e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:44,747 DEBUG [hconnection-0x117cdb04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,748 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:44,756 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:44,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37096ca2 to 127.0.0.1:63130 2023-07-24 13:06:44,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:44,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:06:44,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:44,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:44,763 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:44,765 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204604765 2023-07-24 13:06:44,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 13:06:44,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:44,766 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:44,767 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:44,768 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:44,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:44,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-24 13:06:44,770 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:44,771 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204604771 2023-07-24 13:06:44,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 13:06:44,789 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 13:06:44,789 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,790 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 13:06:44,790 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:06:44,791 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,791 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,793 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,793 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,793 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,793 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,794 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,794 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,794 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,794 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 13:06:44,795 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 13:06:44,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 13:06:44,795 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:44,796 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,795 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,797 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:44,797 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:44,798 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:44,796 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:44,798 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:44,798 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:44,798 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:44,799 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:44,800 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:44,800 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:44,800 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:44,802 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,803 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:44,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,803 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,804 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:44,804 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,804 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdaa8ba[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:44,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdaa8ba[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:44,808 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:06:44,809 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:44,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,810 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:44,810 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:44,811 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,811 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. started... 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:06:44,811 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,811 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 322da94f38ad1f6274154d395ef98121 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 13:06:44,811 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:44,811 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,811 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. started... 2023-07-24 13:06:44,812 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7a3fc27741ade07f9bb1614316a2e752 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 13:06:44,813 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:44,814 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,814 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:44,853 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072472e2911ae6d94453956d6f8d3ae8bb87 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072472e2911ae6d94453956d6f8d3ae8bb87 2023-07-24 13:06:44,854 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307249b917c85f3544f7daa1be00259fc6a2d to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307249b917c85f3544f7daa1be00259fc6a2d 2023-07-24 13:06:44,867 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:44,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:44,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:44,871 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:44,881 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/.tmp/cf/5c44ea1b3b8f45b785762c6323320588 2023-07-24 13:06:44,882 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/.tmp/cf/df49a4bf3a2c493b89b631f6410f4453 2023-07-24 13:06:44,889 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/.tmp/cf/5c44ea1b3b8f45b785762c6323320588 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf/5c44ea1b3b8f45b785762c6323320588 2023-07-24 13:06:44,890 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/.tmp/cf/df49a4bf3a2c493b89b631f6410f4453 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf/df49a4bf3a2c493b89b631f6410f4453 2023-07-24 13:06:44,896 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf/5c44ea1b3b8f45b785762c6323320588, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 13:06:44,896 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf/df49a4bf3a2c493b89b631f6410f4453, entries=46, sequenceid=6, filesize=12.7 K 2023-07-24 13:06:44,897 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7a3fc27741ade07f9bb1614316a2e752 in 85ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:44,897 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 13:06:44,897 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 322da94f38ad1f6274154d395ef98121 in 86ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:44,897 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 322da94f38ad1f6274154d395ef98121: 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a3fc27741ade07f9bb1614316a2e752: 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf/5c44ea1b3b8f45b785762c6323320588] hfiles 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf/df49a4bf3a2c493b89b631f6410f4453] hfiles 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf/df49a4bf3a2c493b89b631f6410f4453 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:44,901 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf/5c44ea1b3b8f45b785762c6323320588 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:44,923 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. completed. 2023-07-24 13:06:44,923 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:06:44,923 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:44,923 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:44,923 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,923 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:44,923 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:06:44,926 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. completed. 2023-07-24 13:06:44,926 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:06:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:44,927 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:06:44,929 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,931 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,931 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:44,931 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,931 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:44,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41971,1690203972955': 2023-07-24 13:06:44,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:06:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:06:44,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:06:44,940 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 13:06:44,940 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:44,940 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:44,940 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 13:06:44,941 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:44,942 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,942 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,943 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,944 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,946 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:44,947 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:44,949 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,949 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,950 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:06:44,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 13:06:44,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:44,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 13:06:44,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:44,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,954 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:06:44,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:44,954 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:44,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:06:44,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,956 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:06:44,957 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,957 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:44,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:44,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072472e2911ae6d94453956d6f8d3ae8bb87, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307249b917c85f3544f7daa1be00259fc6a2d] mob files 2023-07-24 13:06:44,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072472e2911ae6d94453956d6f8d3ae8bb87 2023-07-24 13:06:44,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307249b917c85f3544f7daa1be00259fc6a2d 2023-07-24 13:06:44,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 13:06:44,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 13:06:45,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 13:06:45,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:45,017 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:45,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690204004765Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690204004967 (+202 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690204004967Loading Region manifests for snaptb0-testExportFileSystemState at 1690204004967Writing data manifest for snaptb0-testExportFileSystemState at 1690204004971 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690204004983 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690204005017 (+34 ms) 2023-07-24 13:06:45,021 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:45,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 255 msec 2023-07-24 13:06:45,072 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:45,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:45,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:45,073 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073 2023-07-24 13:06:45,073 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37143, tgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073, rawTgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:45,102 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:06:45,102 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1767409139_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:45,102 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 13:06:45,121 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,178 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,179 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,179 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,160 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-5614005108614061278.jar 2023-07-24 13:06:46,161 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,161 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,237 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-1631043168129812042.jar 2023-07-24 13:06:46,237 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,238 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,239 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,239 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,240 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,240 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:46,241 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:06:46,242 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:06:46,243 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:06:46,243 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:06:46,244 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:06:46,245 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:06:46,245 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:06:46,246 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:06:46,246 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:06:46,247 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:06:46,248 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:46,249 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:46,249 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:46,250 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:46,250 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:46,251 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:46,252 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:46,838 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:06:46,840 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 13:06:46,843 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 13:06:47,735 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:47,735 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:47,742 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:48,576 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0002_000001 (auth:SIMPLE) 2023-07-24 13:06:48,939 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:06:53,352 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0002_000001 (auth:SIMPLE) 2023-07-24 13:06:55,593 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0002_000001 (auth:SIMPLE) 2023-07-24 13:06:58,546 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0002_000001 (auth:SIMPLE) 2023-07-24 13:07:00,046 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:00,049 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:00,071 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 13:07:00,071 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:00,072 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:00,072 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 13:07:00,073 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 13:07:00,073 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 13:07:00,073 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 13:07:00,074 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 13:07:00,074 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204005073/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 13:07:00,084 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 13:07:00,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 13:07:00,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 13:07:00,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204020094"}]},"ts":"1690204020094"} 2023-07-24 13:07:00,096 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 13:07:00,098 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 13:07:00,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, UNASSIGN}] 2023-07-24 13:07:00,101 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, UNASSIGN 2023-07-24 13:07:00,102 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, UNASSIGN 2023-07-24 13:07:00,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7a3fc27741ade07f9bb1614316a2e752, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:00,103 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204020102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204020102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204020102"}]},"ts":"1690204020102"} 2023-07-24 13:07:00,103 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=322da94f38ad1f6274154d395ef98121, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:00,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204020103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204020103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204020103"}]},"ts":"1690204020103"} 2023-07-24 13:07:00,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 7a3fc27741ade07f9bb1614316a2e752, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:00,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 322da94f38ad1f6274154d395ef98121, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:07:00,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 13:07:00,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 322da94f38ad1f6274154d395ef98121 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 322da94f38ad1f6274154d395ef98121, disabling compactions & flushes 2023-07-24 13:07:00,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:07:00,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a3fc27741ade07f9bb1614316a2e752, disabling compactions & flushes 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. after waiting 0 ms 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:07:00,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. after waiting 0 ms 2023-07-24 13:07:00,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:07:00,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:00,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:00,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752. 2023-07-24 13:07:00,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a3fc27741ade07f9bb1614316a2e752: 2023-07-24 13:07:00,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:00,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:00,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:07:00,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121. 2023-07-24 13:07:00,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 322da94f38ad1f6274154d395ef98121: 2023-07-24 13:07:00,291 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7a3fc27741ade07f9bb1614316a2e752, regionState=CLOSED 2023-07-24 13:07:00,291 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204020291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204020291"}]},"ts":"1690204020291"} 2023-07-24 13:07:00,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 322da94f38ad1f6274154d395ef98121 2023-07-24 13:07:00,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=322da94f38ad1f6274154d395ef98121, regionState=CLOSED 2023-07-24 13:07:00,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204020293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204020293"}]},"ts":"1690204020293"} 2023-07-24 13:07:00,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 13:07:00,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 7a3fc27741ade07f9bb1614316a2e752, server=jenkins-hbase4.apache.org,37237,1690203973072 in 189 msec 2023-07-24 13:07:00,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 13:07:00,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7a3fc27741ade07f9bb1614316a2e752, UNASSIGN in 197 msec 2023-07-24 13:07:00,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 322da94f38ad1f6274154d395ef98121, server=jenkins-hbase4.apache.org,41971,1690203972955 in 190 msec 2023-07-24 13:07:00,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 13:07:00,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=322da94f38ad1f6274154d395ef98121, UNASSIGN in 199 msec 2023-07-24 13:07:00,307 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204020307"}]},"ts":"1690204020307"} 2023-07-24 13:07:00,311 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 13:07:00,312 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 13:07:00,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 228 msec 2023-07-24 13:07:00,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 13:07:00,397 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 13:07:00,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 13:07:00,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,404 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 13:07:00,406 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,408 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 13:07:00,413 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,413 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,413 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,413 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:07:00,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:07:00,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:07:00,414 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:07:00,415 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,415 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,415 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,415 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:00,415 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:00,415 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:00,416 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:07:00,416 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:00,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 13:07:00,417 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:07:00,425 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 2023-07-24 13:07:00,427 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/recovered.edits] 2023-07-24 13:07:00,428 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/recovered.edits] 2023-07-24 13:07:00,444 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf/df49a4bf3a2c493b89b631f6410f4453 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/cf/df49a4bf3a2c493b89b631f6410f4453 2023-07-24 13:07:00,445 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf/5c44ea1b3b8f45b785762c6323320588 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/cf/5c44ea1b3b8f45b785762c6323320588 2023-07-24 13:07:00,449 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121/recovered.edits/9.seqid 2023-07-24 13:07:00,449 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/322da94f38ad1f6274154d395ef98121 2023-07-24 13:07:00,449 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752/recovered.edits/9.seqid 2023-07-24 13:07:00,450 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemState/7a3fc27741ade07f9bb1614316a2e752 2023-07-24 13:07:00,450 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 13:07:00,451 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 13:07:00,452 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 13:07:00,458 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072472e2911ae6d94453956d6f8d3ae8bb87 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072472e2911ae6d94453956d6f8d3ae8bb87 2023-07-24 13:07:00,460 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307249b917c85f3544f7daa1be00259fc6a2d to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307249b917c85f3544f7daa1be00259fc6a2d 2023-07-24 13:07:00,460 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 13:07:00,467 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,469 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 13:07:00,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 13:07:00,477 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,477 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 13:07:00,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204020477"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:00,478 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204020477"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:00,481 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:07:00,481 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7a3fc27741ade07f9bb1614316a2e752, NAME => 'testtb-testExportFileSystemState,,1690204003702.7a3fc27741ade07f9bb1614316a2e752.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 322da94f38ad1f6274154d395ef98121, NAME => 'testtb-testExportFileSystemState,1,1690204003702.322da94f38ad1f6274154d395ef98121.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:07:00,481 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 13:07:00,481 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204020481"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:00,484 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 13:07:00,487 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:07:00,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 89 msec 2023-07-24 13:07:00,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 13:07:00,522 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 13:07:00,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 13:07:00,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 13:07:00,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 13:07:00,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 13:07:00,582 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:49246 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:39804 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:37799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_5245557_1 at /127.0.0.1:49234 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_5245557_1 at /127.0.0.1:39784 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2030 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 265) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=5821 (was 6128) 2023-07-24 13:07:00,583 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 13:07:00,612 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=179, AvailableMemoryMB=5820 2023-07-24 13:07:00,612 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 13:07:00,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 13:07:00,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:00,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:00,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 13:07:00,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:00,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:07:00,627 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:00,627 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:00,628 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b empty. 2023-07-24 13:07:00,628 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 empty. 2023-07-24 13:07:00,628 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:00,629 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:00,629 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 13:07:00,653 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:00,654 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c28956eeda45ba80aaa3d98d5b66dc0b, NAME => 'testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:00,655 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1a15d2b06dfa5634c6dd96e482aa56f7, NAME => 'testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:00,685 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:00,685 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:00,685 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 1a15d2b06dfa5634c6dd96e482aa56f7, disabling compactions & flushes 2023-07-24 13:07:00,685 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c28956eeda45ba80aaa3d98d5b66dc0b, disabling compactions & flushes 2023-07-24 13:07:00,685 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:00,685 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. after waiting 0 ms 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. after waiting 0 ms 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:00,686 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:00,686 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 1a15d2b06dfa5634c6dd96e482aa56f7: 2023-07-24 13:07:00,686 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c28956eeda45ba80aaa3d98d5b66dc0b: 2023-07-24 13:07:00,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:00,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204020690"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204020690"}]},"ts":"1690204020690"} 2023-07-24 13:07:00,690 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204020690"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204020690"}]},"ts":"1690204020690"} 2023-07-24 13:07:00,693 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:00,694 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:00,695 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204020694"}]},"ts":"1690204020694"} 2023-07-24 13:07:00,696 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 13:07:00,699 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:00,701 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:00,701 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:00,701 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:00,701 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:00,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, ASSIGN}] 2023-07-24 13:07:00,704 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, ASSIGN 2023-07-24 13:07:00,704 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, ASSIGN 2023-07-24 13:07:00,705 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:07:00,705 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37237,1690203973072; forceNewPlan=false, retain=false 2023-07-24 13:07:00,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:07:00,855 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:00,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c28956eeda45ba80aaa3d98d5b66dc0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:00,858 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1a15d2b06dfa5634c6dd96e482aa56f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:00,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204020858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204020858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204020858"}]},"ts":"1690204020858"} 2023-07-24 13:07:00,858 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204020858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204020858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204020858"}]},"ts":"1690204020858"} 2023-07-24 13:07:00,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure c28956eeda45ba80aaa3d98d5b66dc0b, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:00,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 1a15d2b06dfa5634c6dd96e482aa56f7, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:00,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:07:01,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c28956eeda45ba80aaa3d98d5b66dc0b, NAME => 'testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:07:01,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a15d2b06dfa5634c6dd96e482aa56f7, NAME => 'testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:07:01,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. service=AccessControlService 2023-07-24 13:07:01,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. service=AccessControlService 2023-07-24 13:07:01,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:01,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,022 INFO [StoreOpener-1a15d2b06dfa5634c6dd96e482aa56f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,022 INFO [StoreOpener-c28956eeda45ba80aaa3d98d5b66dc0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,024 DEBUG [StoreOpener-1a15d2b06dfa5634c6dd96e482aa56f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf 2023-07-24 13:07:01,024 DEBUG [StoreOpener-1a15d2b06dfa5634c6dd96e482aa56f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf 2023-07-24 13:07:01,024 INFO [StoreOpener-1a15d2b06dfa5634c6dd96e482aa56f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a15d2b06dfa5634c6dd96e482aa56f7 columnFamilyName cf 2023-07-24 13:07:01,026 INFO [StoreOpener-1a15d2b06dfa5634c6dd96e482aa56f7-1] regionserver.HStore(310): Store=1a15d2b06dfa5634c6dd96e482aa56f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:01,027 DEBUG [StoreOpener-c28956eeda45ba80aaa3d98d5b66dc0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf 2023-07-24 13:07:01,027 DEBUG [StoreOpener-c28956eeda45ba80aaa3d98d5b66dc0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf 2023-07-24 13:07:01,027 INFO [StoreOpener-c28956eeda45ba80aaa3d98d5b66dc0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c28956eeda45ba80aaa3d98d5b66dc0b columnFamilyName cf 2023-07-24 13:07:01,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,029 INFO [StoreOpener-c28956eeda45ba80aaa3d98d5b66dc0b-1] regionserver.HStore(310): Store=c28956eeda45ba80aaa3d98d5b66dc0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:01,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:01,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:01,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:01,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a15d2b06dfa5634c6dd96e482aa56f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63702997, jitterRate=-0.050751373171806335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:01,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a15d2b06dfa5634c6dd96e482aa56f7: 2023-07-24 13:07:01,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7., pid=46, masterSystemTime=1690204021013 2023-07-24 13:07:01,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:01,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c28956eeda45ba80aaa3d98d5b66dc0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62342134, jitterRate=-0.07102981209754944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:01,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c28956eeda45ba80aaa3d98d5b66dc0b: 2023-07-24 13:07:01,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b., pid=45, masterSystemTime=1690204021012 2023-07-24 13:07:01,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1a15d2b06dfa5634c6dd96e482aa56f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,038 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204021038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204021038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204021038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204021038"}]},"ts":"1690204021038"} 2023-07-24 13:07:01,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,041 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c28956eeda45ba80aaa3d98d5b66dc0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,041 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204021041"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204021041"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204021041"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204021041"}]},"ts":"1690204021041"} 2023-07-24 13:07:01,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-24 13:07:01,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 1a15d2b06dfa5634c6dd96e482aa56f7, server=jenkins-hbase4.apache.org,43445,1690203973024 in 179 msec 2023-07-24 13:07:01,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, ASSIGN in 342 msec 2023-07-24 13:07:01,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-24 13:07:01,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure c28956eeda45ba80aaa3d98d5b66dc0b, server=jenkins-hbase4.apache.org,37237,1690203973072 in 183 msec 2023-07-24 13:07:01,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 13:07:01,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, ASSIGN in 344 msec 2023-07-24 13:07:01,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:01,054 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204021054"}]},"ts":"1690204021054"} 2023-07-24 13:07:01,055 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 13:07:01,059 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:01,060 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 13:07:01,062 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 13:07:01,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:01,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:01,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:01,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:01,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:01,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:01,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:01,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:01,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 450 msec 2023-07-24 13:07:01,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:07:01,229 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 13:07:01,232 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 13:07:01,232 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,234 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:01,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:01,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204021248 (current time:1690204021248). 2023-07-24 13:07:01,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:01,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x20830e5a to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:01,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c01f80a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:01,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:01,261 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:01,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20830e5a to 127.0.0.1:63130 2023-07-24 13:07:01,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:01,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x3f2c2172 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:01,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4511d202, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:01,271 DEBUG [hconnection-0x76e3a302-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:01,274 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:01,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:01,281 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:01,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f2c2172 to 127.0.0.1:63130 2023-07-24 13:07:01,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:01,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 13:07:01,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:01,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:01,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:01,287 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:01,288 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690204621287 2023-07-24 13:07:01,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 13:07:01,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:01,289 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:01,289 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:01,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:01,290 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:01,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-24 13:07:01,292 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:01,293 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690204621293 2023-07-24 13:07:01,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,314 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 13:07:01,314 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,314 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 13:07:01,315 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 13:07:01,315 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,315 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,317 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,317 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,317 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,317 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,318 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,318 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,318 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,319 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:01,319 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:01,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 13:07:01,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,320 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:01,320 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:01,320 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,320 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:01,321 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:01,321 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:01,321 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:01,321 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,321 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,322 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:01,321 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:01,328 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,328 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,328 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,333 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,333 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,333 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,334 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:01,334 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,334 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:01,334 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,334 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:01,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:07:01,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f07c5b4[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:07:01,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f07c5b4[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:01,339 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 13:07:01,339 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:01,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:01,341 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:07:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,341 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,341 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:01,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,342 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:01,342 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:01,342 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:01,342 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,342 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:01,342 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:01,342 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. started... 2023-07-24 13:07:01,342 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,342 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. started... 2023-07-24 13:07:01,342 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,344 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:01,344 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c28956eeda45ba80aaa3d98d5b66dc0b: 2023-07-24 13:07:01,344 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1a15d2b06dfa5634c6dd96e482aa56f7: 2023-07-24 13:07:01,344 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,345 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:01,345 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,345 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:01,345 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:01,345 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:01,348 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:01,348 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,348 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:01,379 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. completed. 2023-07-24 13:07:01,379 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. completed. 2023-07-24 13:07:01,379 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,379 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,379 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:01,379 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,379 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:07:01,380 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:07:01,382 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,382 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:01,382 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,382 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,382 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:01,382 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:01,383 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,383 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:01,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 13:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,389 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:01,391 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:01,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:07:01,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 13:07:01,392 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 13:07:01,392 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:01,392 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:01,392 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,392 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,394 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,395 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,396 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,398 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,399 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,399 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,402 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,402 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,402 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,402 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,403 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,402 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,403 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:07:01,404 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,405 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,405 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,405 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,406 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 13:07:01,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 13:07:01,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,474 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:01,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690204021288Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690204021417 (+129 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690204021417Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690204021417Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690204021420 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690204021436 (+16 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690204021473 (+37 ms) 2023-07-24 13:07:01,478 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:01,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 189 msec 2023-07-24 13:07:01,591 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:01,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:01,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:01,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37237] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:01,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:01,600 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 13:07:01,600 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,600 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:01,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:01,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204021611 (current time:1690204021611). 2023-07-24 13:07:01,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:01,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x31812639 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:01,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@357ea090, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:01,627 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:01,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31812639 to 127.0.0.1:63130 2023-07-24 13:07:01,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:01,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x5c8e9bab to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:01,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6486ceed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:01,638 DEBUG [hconnection-0x243c88cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:01,642 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:01,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:01,648 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:01,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c8e9bab to 127.0.0.1:63130 2023-07-24 13:07:01,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:01,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 13:07:01,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:01,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:01,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:01,654 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:01,655 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690204621655 2023-07-24 13:07:01,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 13:07:01,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:01,656 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:01,656 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:01,657 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:01,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:01,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-24 13:07:01,660 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:01,661 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690204621660 2023-07-24 13:07:01,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 13:07:01,675 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 13:07:01,675 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,676 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 13:07:01,676 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 13:07:01,677 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,677 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,679 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,679 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,679 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,679 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,680 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,680 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,680 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,680 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 13:07:01,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 13:07:01,682 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:01,682 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:01,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 13:07:01,682 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,682 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:01,684 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,682 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:01,686 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:01,684 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:01,687 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:01,687 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:01,688 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:01,687 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:01,687 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:01,688 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:01,688 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:01,689 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,691 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,692 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,692 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:01,691 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,692 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,692 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:01,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:07:01,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42ee03b4[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:07:01,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42ee03b4[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:01,697 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 13:07:01,697 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,700 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:01,700 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:01,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,701 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:01,701 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:01,701 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:07:01,702 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,702 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:01,702 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:01,703 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:01,703 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. started... 2023-07-24 13:07:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:01,703 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,703 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. started... 2023-07-24 13:07:01,703 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1a15d2b06dfa5634c6dd96e482aa56f7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 13:07:01,703 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c28956eeda45ba80aaa3d98d5b66dc0b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 13:07:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:01,703 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,704 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:01,706 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,706 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:01,729 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307241e6453f5819f49239ebd8692681a7382 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307241e6453f5819f49239ebd8692681a7382 2023-07-24 13:07:01,731 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307246c77cc89bf6044719b129a1dd85a3cca to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246c77cc89bf6044719b129a1dd85a3cca 2023-07-24 13:07:01,745 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/.tmp/cf/c06500d85f164fce8b9372f9b3f225a6 2023-07-24 13:07:01,746 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/.tmp/cf/988a500bf72045b3937aa492cb807172 2023-07-24 13:07:01,754 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/.tmp/cf/c06500d85f164fce8b9372f9b3f225a6 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf/c06500d85f164fce8b9372f9b3f225a6 2023-07-24 13:07:01,754 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/.tmp/cf/988a500bf72045b3937aa492cb807172 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf/988a500bf72045b3937aa492cb807172 2023-07-24 13:07:01,756 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:01,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:01,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:01,758 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:01,760 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf/988a500bf72045b3937aa492cb807172, entries=48, sequenceid=6, filesize=12.9 K 2023-07-24 13:07:01,760 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf/c06500d85f164fce8b9372f9b3f225a6, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 13:07:01,761 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c28956eeda45ba80aaa3d98d5b66dc0b in 58ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:01,761 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 1a15d2b06dfa5634c6dd96e482aa56f7 in 58ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:01,761 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 13:07:01,762 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c28956eeda45ba80aaa3d98d5b66dc0b: 2023-07-24 13:07:01,762 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:01,762 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:01,762 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf/c06500d85f164fce8b9372f9b3f225a6] hfiles 2023-07-24 13:07:01,762 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf/c06500d85f164fce8b9372f9b3f225a6 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:01,761 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 13:07:01,764 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1a15d2b06dfa5634c6dd96e482aa56f7: 2023-07-24 13:07:01,764 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:01,764 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:01,764 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf/988a500bf72045b3937aa492cb807172] hfiles 2023-07-24 13:07:01,765 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf/988a500bf72045b3937aa492cb807172 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:01,779 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. completed. 2023-07-24 13:07:01,779 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:01,779 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:01,779 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:01,779 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,780 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:01,780 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:07:01,784 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:01,784 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,784 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,784 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:01,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:07:01,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 13:07:01,791 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. completed. 2023-07-24 13:07:01,792 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:01,792 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:01,792 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:01,792 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,792 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:01,792 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:07:01,794 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:01,794 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,794 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,794 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:01,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:07:01,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 13:07:01,799 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 13:07:01,799 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:01,799 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:01,799 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 13:07:01,799 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,802 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,803 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,804 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:01,804 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:01,806 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:01,807 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,807 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:01,815 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,814 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:01,815 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:01,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 13:07:01,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:01,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,815 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:01,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:01,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:07:01,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:01,815 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:01,818 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,818 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246c77cc89bf6044719b129a1dd85a3cca, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307241e6453f5819f49239ebd8692681a7382] mob files 2023-07-24 13:07:01,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246c77cc89bf6044719b129a1dd85a3cca 2023-07-24 13:07:01,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307241e6453f5819f49239ebd8692681a7382 2023-07-24 13:07:01,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 13:07:01,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 13:07:01,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,877 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690204021655Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690204021833 (+178 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690204021833Loading Region manifests for snaptb0-testConsecutiveExports at 1690204021834 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690204021840 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690204021849 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690204021876 (+27 ms) 2023-07-24 13:07:01,880 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:01,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 224 msec 2023-07-24 13:07:01,958 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:01,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:01,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:01,960 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960 2023-07-24 13:07:01,960 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:07:01,987 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:07:01,988 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@19d0abf7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:01,988 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 13:07:01,997 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:02,017 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,018 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,018 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,018 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,980 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-5407644425477206568.jar 2023-07-24 13:07:02,980 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,981 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,049 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-5783854293458852322.jar 2023-07-24 13:07:03,050 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,050 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,051 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,051 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,051 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,052 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:03,052 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:03,052 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:03,053 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:03,053 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:03,053 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:03,054 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:03,054 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:03,055 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:03,055 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:03,056 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:03,056 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:03,057 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:03,057 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:03,057 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:03,058 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:03,058 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:03,059 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:03,427 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:03,429 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 13:07:03,431 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 13:07:04,724 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:04,724 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:04,728 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0002_000001 (auth:SIMPLE) 2023-07-24 13:07:04,747 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:05,924 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:07:09,544 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:11,826 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:15,007 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:16,613 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:16,613 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:16,618 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 13:07:16,618 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:16,619 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:16,619 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:16,622 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:16,622 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:16,622 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@40f17655 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:16,622 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:16,622 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:16,623 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:07:16,647 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:07:16,647 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@24c1e623, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:16,647 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 13:07:16,657 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:16,668 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,669 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,669 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,670 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,618 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-2068493063436589216.jar 2023-07-24 13:07:17,618 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,619 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,687 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-3258738842752752750.jar 2023-07-24 13:07:17,688 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,688 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,688 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,689 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,689 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,689 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:17,690 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:17,690 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:17,691 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:17,691 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:17,691 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:17,692 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:17,692 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:17,693 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:17,693 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:17,694 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:17,694 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:17,694 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:17,695 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:17,695 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:17,696 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:17,696 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:17,697 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:18,102 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:18,105 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 13:07:18,107 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 13:07:21,181 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:21,181 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:21,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:22,030 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:26,886 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:29,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:33,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:34,317 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:34,317 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:34,326 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 13:07:34,327 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:34,327 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:34,327 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:34,334 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:34,334 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:34,334 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@40f17655 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:34,334 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:34,335 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/local-export-1690204021960/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:34,349 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 13:07:34,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 13:07:34,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,362 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204054362"}]},"ts":"1690204054362"} 2023-07-24 13:07:34,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 13:07:34,364 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 13:07:34,366 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 13:07:34,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, UNASSIGN}] 2023-07-24 13:07:34,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, UNASSIGN 2023-07-24 13:07:34,371 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, UNASSIGN 2023-07-24 13:07:34,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c28956eeda45ba80aaa3d98d5b66dc0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:34,372 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1a15d2b06dfa5634c6dd96e482aa56f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:34,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204054372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204054372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204054372"}]},"ts":"1690204054372"} 2023-07-24 13:07:34,372 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204054372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204054372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204054372"}]},"ts":"1690204054372"} 2023-07-24 13:07:34,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure c28956eeda45ba80aaa3d98d5b66dc0b, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:34,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 1a15d2b06dfa5634c6dd96e482aa56f7, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:34,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 13:07:34,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:34,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c28956eeda45ba80aaa3d98d5b66dc0b, disabling compactions & flushes 2023-07-24 13:07:34,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:34,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:34,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. after waiting 0 ms 2023-07-24 13:07:34,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:34,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:34,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a15d2b06dfa5634c6dd96e482aa56f7, disabling compactions & flushes 2023-07-24 13:07:34,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:34,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:34,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. after waiting 0 ms 2023-07-24 13:07:34,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:34,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:34,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:34,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7. 2023-07-24 13:07:34,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a15d2b06dfa5634c6dd96e482aa56f7: 2023-07-24 13:07:34,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:34,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:34,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:34,580 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1a15d2b06dfa5634c6dd96e482aa56f7, regionState=CLOSED 2023-07-24 13:07:34,580 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204054580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204054580"}]},"ts":"1690204054580"} 2023-07-24 13:07:34,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b. 2023-07-24 13:07:34,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c28956eeda45ba80aaa3d98d5b66dc0b: 2023-07-24 13:07:34,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:34,598 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c28956eeda45ba80aaa3d98d5b66dc0b, regionState=CLOSED 2023-07-24 13:07:34,598 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204054598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204054598"}]},"ts":"1690204054598"} 2023-07-24 13:07:34,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 13:07:34,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 1a15d2b06dfa5634c6dd96e482aa56f7, server=jenkins-hbase4.apache.org,43445,1690203973024 in 209 msec 2023-07-24 13:07:34,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1a15d2b06dfa5634c6dd96e482aa56f7, UNASSIGN in 233 msec 2023-07-24 13:07:34,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 13:07:34,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure c28956eeda45ba80aaa3d98d5b66dc0b, server=jenkins-hbase4.apache.org,37237,1690203973072 in 225 msec 2023-07-24 13:07:34,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-24 13:07:34,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c28956eeda45ba80aaa3d98d5b66dc0b, UNASSIGN in 236 msec 2023-07-24 13:07:34,605 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204054605"}]},"ts":"1690204054605"} 2023-07-24 13:07:34,607 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 13:07:34,609 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 13:07:34,612 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 261 msec 2023-07-24 13:07:34,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 13:07:34,667 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 13:07:34,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 13:07:34,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,672 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 13:07:34,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,676 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 13:07:34,679 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,679 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,680 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:34,680 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:34,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:34,681 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:34,682 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:34,682 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:34,684 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:34,685 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/recovered.edits] 2023-07-24 13:07:34,688 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/recovered.edits] 2023-07-24 13:07:34,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 13:07:34,693 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf/c06500d85f164fce8b9372f9b3f225a6 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/cf/c06500d85f164fce8b9372f9b3f225a6 2023-07-24 13:07:34,694 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf/988a500bf72045b3937aa492cb807172 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/cf/988a500bf72045b3937aa492cb807172 2023-07-24 13:07:34,698 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b/recovered.edits/9.seqid 2023-07-24 13:07:34,698 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7/recovered.edits/9.seqid 2023-07-24 13:07:34,699 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/c28956eeda45ba80aaa3d98d5b66dc0b 2023-07-24 13:07:34,699 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testConsecutiveExports/1a15d2b06dfa5634c6dd96e482aa56f7 2023-07-24 13:07:34,699 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 13:07:34,700 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 13:07:34,701 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 13:07:34,706 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246c77cc89bf6044719b129a1dd85a3cca to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246c77cc89bf6044719b129a1dd85a3cca 2023-07-24 13:07:34,708 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307241e6453f5819f49239ebd8692681a7382 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307241e6453f5819f49239ebd8692681a7382 2023-07-24 13:07:34,709 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 13:07:34,712 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,715 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 13:07:34,718 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 13:07:34,720 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,721 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 13:07:34,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204054721"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:34,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204054721"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:34,724 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:07:34,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c28956eeda45ba80aaa3d98d5b66dc0b, NAME => 'testtb-testConsecutiveExports,,1690204020614.c28956eeda45ba80aaa3d98d5b66dc0b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1a15d2b06dfa5634c6dd96e482aa56f7, NAME => 'testtb-testConsecutiveExports,1,1690204020614.1a15d2b06dfa5634c6dd96e482aa56f7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:07:34,725 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 13:07:34,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204054725"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:34,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 13:07:34,729 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:34,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 62 msec 2023-07-24 13:07:34,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 13:07:34,791 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 13:07:34,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 13:07:34,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:34,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 13:07:34,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 13:07:34,856 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 763), OpenFileDescriptor=892 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=416 (was 316) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5565 (was 5820) 2023-07-24 13:07:34,856 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-24 13:07:34,884 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=416, ProcessCount=181, AvailableMemoryMB=5561 2023-07-24 13:07:34,884 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-24 13:07:34,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 13:07:34,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,895 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:34,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 13:07:34,896 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:34,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:34,903 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:34,904 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 empty. 2023-07-24 13:07:34,911 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:34,911 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:34,911 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 empty. 2023-07-24 13:07:34,913 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:34,913 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 13:07:34,941 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:34,943 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1f862f9af97ae00fc0529055cc83cfe4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:34,943 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 776efa8750bfc2a100ff3d67794b07e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:34,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:34,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 1f862f9af97ae00fc0529055cc83cfe4, disabling compactions & flushes 2023-07-24 13:07:34,992 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:34,992 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:34,993 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. after waiting 0 ms 2023-07-24 13:07:34,993 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:34,993 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:34,993 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 1f862f9af97ae00fc0529055cc83cfe4: 2023-07-24 13:07:34,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:34,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 776efa8750bfc2a100ff3d67794b07e5, disabling compactions & flushes 2023-07-24 13:07:34,996 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:34,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:34,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. after waiting 0 ms 2023-07-24 13:07:34,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:34,996 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:34,996 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 776efa8750bfc2a100ff3d67794b07e5: 2023-07-24 13:07:35,001 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:35,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:35,002 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204055002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204055002"}]},"ts":"1690204055002"} 2023-07-24 13:07:35,002 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204055002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204055002"}]},"ts":"1690204055002"} 2023-07-24 13:07:35,010 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:35,013 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:35,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204055013"}]},"ts":"1690204055013"} 2023-07-24 13:07:35,015 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 13:07:35,024 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:35,026 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:35,026 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:35,026 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:35,026 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:35,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, ASSIGN}] 2023-07-24 13:07:35,030 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, ASSIGN 2023-07-24 13:07:35,030 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, ASSIGN 2023-07-24 13:07:35,035 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:07:35,035 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37237,1690203973072; forceNewPlan=false, retain=false 2023-07-24 13:07:35,185 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:35,188 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1f862f9af97ae00fc0529055cc83cfe4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=776efa8750bfc2a100ff3d67794b07e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204055188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204055188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204055188"}]},"ts":"1690204055188"} 2023-07-24 13:07:35,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204055188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204055188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204055188"}]},"ts":"1690204055188"} 2023-07-24 13:07:35,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 1f862f9af97ae00fc0529055cc83cfe4, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:35,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 776efa8750bfc2a100ff3d67794b07e5, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:35,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:35,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1f862f9af97ae00fc0529055cc83cfe4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:07:35,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. service=AccessControlService 2023-07-24 13:07:35,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 776efa8750bfc2a100ff3d67794b07e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:07:35,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. service=AccessControlService 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,348 INFO [StoreOpener-1f862f9af97ae00fc0529055cc83cfe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,348 INFO [StoreOpener-776efa8750bfc2a100ff3d67794b07e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,350 DEBUG [StoreOpener-1f862f9af97ae00fc0529055cc83cfe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf 2023-07-24 13:07:35,350 DEBUG [StoreOpener-1f862f9af97ae00fc0529055cc83cfe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf 2023-07-24 13:07:35,350 DEBUG [StoreOpener-776efa8750bfc2a100ff3d67794b07e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf 2023-07-24 13:07:35,351 DEBUG [StoreOpener-776efa8750bfc2a100ff3d67794b07e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf 2023-07-24 13:07:35,351 INFO [StoreOpener-1f862f9af97ae00fc0529055cc83cfe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f862f9af97ae00fc0529055cc83cfe4 columnFamilyName cf 2023-07-24 13:07:35,351 INFO [StoreOpener-776efa8750bfc2a100ff3d67794b07e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 776efa8750bfc2a100ff3d67794b07e5 columnFamilyName cf 2023-07-24 13:07:35,357 INFO [StoreOpener-776efa8750bfc2a100ff3d67794b07e5-1] regionserver.HStore(310): Store=776efa8750bfc2a100ff3d67794b07e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:35,357 INFO [StoreOpener-1f862f9af97ae00fc0529055cc83cfe4-1] regionserver.HStore(310): Store=1f862f9af97ae00fc0529055cc83cfe4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:35,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:35,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:35,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:35,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 776efa8750bfc2a100ff3d67794b07e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70066743, jitterRate=0.04407583177089691}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 776efa8750bfc2a100ff3d67794b07e5: 2023-07-24 13:07:35,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5., pid=61, masterSystemTime=1690204055343 2023-07-24 13:07:35,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:35,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1f862f9af97ae00fc0529055cc83cfe4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69932673, jitterRate=0.042078033089637756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:35,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1f862f9af97ae00fc0529055cc83cfe4: 2023-07-24 13:07:35,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4., pid=60, masterSystemTime=1690204055342 2023-07-24 13:07:35,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,370 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=776efa8750bfc2a100ff3d67794b07e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,371 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204055370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204055370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204055370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204055370"}]},"ts":"1690204055370"} 2023-07-24 13:07:35,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:35,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:35,371 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=1f862f9af97ae00fc0529055cc83cfe4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204055371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204055371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204055371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204055371"}]},"ts":"1690204055371"} 2023-07-24 13:07:35,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-24 13:07:35,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 776efa8750bfc2a100ff3d67794b07e5, server=jenkins-hbase4.apache.org,37237,1690203973072 in 182 msec 2023-07-24 13:07:35,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, ASSIGN in 349 msec 2023-07-24 13:07:35,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-24 13:07:35,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 1f862f9af97ae00fc0529055cc83cfe4, server=jenkins-hbase4.apache.org,43445,1690203973024 in 188 msec 2023-07-24 13:07:35,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 13:07:35,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, ASSIGN in 354 msec 2023-07-24 13:07:35,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:35,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204055384"}]},"ts":"1690204055384"} 2023-07-24 13:07:35,386 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 13:07:35,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:35,390 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 13:07:35,393 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 13:07:35,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,394 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 510 msec 2023-07-24 13:07:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:35,504 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 13:07:35,507 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,507 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,509 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:35,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:35,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204055535 (current time:1690204055535). 2023-07-24 13:07:35,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:35,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x5d51bc57 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:35,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37ad6055, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:35,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:35,561 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:35,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d51bc57 to 127.0.0.1:63130 2023-07-24 13:07:35,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:35,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x15c2be88 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:35,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45211b63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:35,574 DEBUG [hconnection-0x1952645a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:35,575 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:35,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:35,584 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:35,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15c2be88 to 127.0.0.1:63130 2023-07-24 13:07:35,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:35,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 13:07:35,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:35,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:35,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:35,591 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:35,592 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690204655592 2023-07-24 13:07:35,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:35,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:35,595 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:35,595 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:35,595 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:35,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-24 13:07:35,602 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:35,611 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690204655611 2023-07-24 13:07:35,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,628 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 13:07:35,628 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:35,630 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 13:07:35,630 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 13:07:35,630 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,631 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,632 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,632 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,632 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,632 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,633 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,633 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,634 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,634 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,634 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:35,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,635 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:35,635 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:35,634 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:35,635 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:35,636 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:35,637 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:35,637 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:35,635 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:35,637 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:35,639 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:35,639 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:35,639 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:35,637 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:35,639 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:35,641 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,642 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,642 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:35,643 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:35,643 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:35,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18a21785[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:35,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:35,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:35,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:35,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:35,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18a21785[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:35,647 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 13:07:35,647 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,648 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:35,649 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,649 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:35,649 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. started... 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:35,649 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:35,649 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 776efa8750bfc2a100ff3d67794b07e5: 2023-07-24 13:07:35,649 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:35,649 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:35,649 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. started... 2023-07-24 13:07:35,650 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,650 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:35,650 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:35,651 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f862f9af97ae00fc0529055cc83cfe4: 2023-07-24 13:07:35,651 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,652 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:35,652 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:35,655 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:35,655 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:35,655 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:35,671 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. completed. 2023-07-24 13:07:35,671 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:35,671 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:35,671 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:35,671 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,671 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:35,671 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:07:35,672 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. completed. 2023-07-24 13:07:35,672 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:07:35,673 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:35,673 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,673 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:35,673 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:35,674 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,674 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:35,674 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:35,674 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:07:35,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 13:07:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:35,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:35,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:35,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:07:35,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 13:07:35,683 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 13:07:35,683 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:35,683 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:35,683 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,683 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:35,686 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,686 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,686 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:35,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,686 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,686 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:35,687 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,687 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:35,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:35,688 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:35,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:35,688 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,691 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:35,692 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,695 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:35,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:35,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,697 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:35,697 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:35,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:35,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,701 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,701 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:35,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,701 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:35,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:35,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,702 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,704 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:35,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:07:35,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:35,704 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,704 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,704 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:35,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:35,704 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,705 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 13:07:35,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 13:07:35,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,785 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690204055592Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690204055720 (+128 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204055720Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204055720Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204055727 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204055757 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690204055784 (+27 ms) 2023-07-24 13:07:35,788 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:35,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 195 msec 2023-07-24 13:07:35,897 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:35,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:35,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:35,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37237] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:35,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,905 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:35,905 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:35,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:35,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204055916 (current time:1690204055916). 2023-07-24 13:07:35,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:35,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x61f873e1 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:35,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f20adc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:35,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:35,929 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:35,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61f873e1 to 127.0.0.1:63130 2023-07-24 13:07:35,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:35,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x1b2785a7 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:35,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39628a59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:35,939 DEBUG [hconnection-0x1e61d343-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:35,943 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:35,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:35,951 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:35,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b2785a7 to 127.0.0.1:63130 2023-07-24 13:07:35,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:35,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 13:07:35,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:35,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:35,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:35,962 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:35,963 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690204655963 2023-07-24 13:07:35,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:35,965 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:35,965 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:35,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:35,967 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:35,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-24 13:07:35,970 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:35,970 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690204655970 2023-07-24 13:07:35,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,990 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 13:07:35,990 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:35,992 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 13:07:35,992 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 13:07:35,993 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,993 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,995 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:35,995 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,995 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:35,996 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:35,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:35,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,002 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,003 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 13:07:36,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,004 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:36,004 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:36,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:36,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,004 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,004 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:36,004 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:36,004 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:36,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:36,022 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:36,022 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:36,022 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:36,020 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:36,023 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:36,024 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:36,024 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:36,025 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,025 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,025 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:36,027 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,027 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:36,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:36,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:36,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623e353[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:36,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:36,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:36,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@623e353[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:36,032 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 13:07:36,032 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,035 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:36,035 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,035 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:36,035 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:36,035 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:36,035 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:07:36,036 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,036 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:36,037 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:36,037 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:36,037 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:36,042 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:36,042 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:36,043 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:36,043 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. started... 2023-07-24 13:07:36,042 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:36,043 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. started... 2023-07-24 13:07:36,043 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 776efa8750bfc2a100ff3d67794b07e5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 13:07:36,043 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1f862f9af97ae00fc0529055cc83cfe4 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 13:07:36,065 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:36,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:36,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:36,067 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:36,080 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307244bcc661639144a768ef9383df87eccf9 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307244bcc661639144a768ef9383df87eccf9 2023-07-24 13:07:36,089 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/.tmp/cf/4e4bb3a361db4f1c8dcd11e033d8ccba 2023-07-24 13:07:36,094 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/.tmp/cf/4e4bb3a361db4f1c8dcd11e033d8ccba as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf/4e4bb3a361db4f1c8dcd11e033d8ccba 2023-07-24 13:07:36,099 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf/4e4bb3a361db4f1c8dcd11e033d8ccba, entries=47, sequenceid=6, filesize=13.5 K 2023-07-24 13:07:36,100 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1f862f9af97ae00fc0529055cc83cfe4 in 57ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:36,100 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 13:07:36,101 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1f862f9af97ae00fc0529055cc83cfe4: 2023-07-24 13:07:36,101 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,101 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:36,101 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf/4e4bb3a361db4f1c8dcd11e033d8ccba] hfiles 2023-07-24 13:07:36,101 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf/4e4bb3a361db4f1c8dcd11e033d8ccba for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,111 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. completed. 2023-07-24 13:07:36,111 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:36,111 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:36,111 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:36,111 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,111 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:36,111 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:07:36,113 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,113 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:36,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,113 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:36,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:36,114 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:36,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:36,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:36,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:36,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:36,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:07:36,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 13:07:36,267 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:36,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:36,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:36,272 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:07:36,486 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724f9774e7053e544538924f0707888f70e to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f9774e7053e544538924f0707888f70e 2023-07-24 13:07:36,518 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/.tmp/cf/636776f0c4144de69c137e6a573dd327 2023-07-24 13:07:36,524 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/.tmp/cf/636776f0c4144de69c137e6a573dd327 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf/636776f0c4144de69c137e6a573dd327 2023-07-24 13:07:36,530 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf/636776f0c4144de69c137e6a573dd327, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 13:07:36,531 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 776efa8750bfc2a100ff3d67794b07e5 in 488ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:36,533 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 776efa8750bfc2a100ff3d67794b07e5: 2023-07-24 13:07:36,533 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,533 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:36,533 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf/636776f0c4144de69c137e6a573dd327] hfiles 2023-07-24 13:07:36,533 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf/636776f0c4144de69c137e6a573dd327 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,544 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. completed. 2023-07-24 13:07:36,544 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:36,544 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:36,544 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:36,544 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,544 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:36,545 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:07:36,547 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:36,547 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,547 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,548 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:07:36,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 13:07:36,553 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 13:07:36,553 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:36,553 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:36,553 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,554 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:36,564 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,564 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:36,564 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:36,564 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:36,564 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:36,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:36,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:36,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:36,566 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:36,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,567 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:36,571 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,571 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,571 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,572 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:36,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:36,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:36,573 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:36,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:36,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:36,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,576 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:36,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:36,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:36,576 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:36,578 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,579 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:36,579 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,579 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:36,579 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:36,579 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,579 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:36,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:36,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:07:36,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307244bcc661639144a768ef9383df87eccf9, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f9774e7053e544538924f0707888f70e] mob files 2023-07-24 13:07:36,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307244bcc661639144a768ef9383df87eccf9 2023-07-24 13:07:36,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f9774e7053e544538924f0707888f70e 2023-07-24 13:07:36,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 13:07:36,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,640 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:36,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690204055963Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690204056588 (+625 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690204056588Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690204056589 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690204056593 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690204056611 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690204056640 (+29 ms) 2023-07-24 13:07:36,643 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:36,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 678 msec 2023-07-24 13:07:37,073 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:37,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:37,107 DEBUG [Listener at jenkins-hbase4.apache.org/44893] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:07:37,117 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:07:37,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37237] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 13:07:37,121 DEBUG [Listener at jenkins-hbase4.apache.org/44893] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:07:37,123 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:07:37,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41971] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 13:07:37,125 DEBUG [Listener at jenkins-hbase4.apache.org/44893] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:07:37,127 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:07:37,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 13:07:37,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:07:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,138 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:37,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 13:07:37,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:37,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:37,142 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,143 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,143 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed empty. 2023-07-24 13:07:37,143 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 empty. 2023-07-24 13:07:37,144 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,144 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 13:07:37,188 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:37,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d6a1b2905ffe609f1a59ee214e4c06ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:37,190 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 90b6376aa60be0c26f7a3d3554f501e2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:37,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:37,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d6a1b2905ffe609f1a59ee214e4c06ed, disabling compactions & flushes 2023-07-24 13:07:37,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. after waiting 0 ms 2023-07-24 13:07:37,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,205 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,205 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d6a1b2905ffe609f1a59ee214e4c06ed: 2023-07-24 13:07:37,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:37,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 90b6376aa60be0c26f7a3d3554f501e2, disabling compactions & flushes 2023-07-24 13:07:37,206 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. after waiting 0 ms 2023-07-24 13:07:37,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,206 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,206 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 90b6376aa60be0c26f7a3d3554f501e2: 2023-07-24 13:07:37,209 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:37,210 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204057210"}]},"ts":"1690204057210"} 2023-07-24 13:07:37,210 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204057210"}]},"ts":"1690204057210"} 2023-07-24 13:07:37,213 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:37,214 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:37,214 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204057214"}]},"ts":"1690204057214"} 2023-07-24 13:07:37,216 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 13:07:37,219 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:37,221 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:37,221 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:37,221 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:37,221 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:37,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, ASSIGN}] 2023-07-24 13:07:37,225 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, ASSIGN 2023-07-24 13:07:37,225 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, ASSIGN 2023-07-24 13:07:37,226 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37237,1690203973072; forceNewPlan=false, retain=false 2023-07-24 13:07:37,226 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:07:37,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:37,376 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:37,379 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=90b6376aa60be0c26f7a3d3554f501e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:37,379 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d6a1b2905ffe609f1a59ee214e4c06ed, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:37,379 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204057379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204057379"}]},"ts":"1690204057379"} 2023-07-24 13:07:37,379 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204057379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204057379"}]},"ts":"1690204057379"} 2023-07-24 13:07:37,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 90b6376aa60be0c26f7a3d3554f501e2, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:37,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d6a1b2905ffe609f1a59ee214e4c06ed, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:37,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:37,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90b6376aa60be0c26f7a3d3554f501e2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 13:07:37,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. service=AccessControlService 2023-07-24 13:07:37,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:37,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:37,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,539 INFO [StoreOpener-90b6376aa60be0c26f7a3d3554f501e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,541 DEBUG [StoreOpener-90b6376aa60be0c26f7a3d3554f501e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf 2023-07-24 13:07:37,541 DEBUG [StoreOpener-90b6376aa60be0c26f7a3d3554f501e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf 2023-07-24 13:07:37,542 INFO [StoreOpener-90b6376aa60be0c26f7a3d3554f501e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90b6376aa60be0c26f7a3d3554f501e2 columnFamilyName cf 2023-07-24 13:07:37,542 INFO [StoreOpener-90b6376aa60be0c26f7a3d3554f501e2-1] regionserver.HStore(310): Store=90b6376aa60be0c26f7a3d3554f501e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:37,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6a1b2905ffe609f1a59ee214e4c06ed, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 13:07:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. service=AccessControlService 2023-07-24 13:07:37,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,549 INFO [StoreOpener-d6a1b2905ffe609f1a59ee214e4c06ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,551 DEBUG [StoreOpener-d6a1b2905ffe609f1a59ee214e4c06ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf 2023-07-24 13:07:37,551 DEBUG [StoreOpener-d6a1b2905ffe609f1a59ee214e4c06ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf 2023-07-24 13:07:37,552 INFO [StoreOpener-d6a1b2905ffe609f1a59ee214e4c06ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6a1b2905ffe609f1a59ee214e4c06ed columnFamilyName cf 2023-07-24 13:07:37,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,553 INFO [StoreOpener-d6a1b2905ffe609f1a59ee214e4c06ed-1] regionserver.HStore(310): Store=d6a1b2905ffe609f1a59ee214e4c06ed/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:37,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:37,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:37,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d6a1b2905ffe609f1a59ee214e4c06ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65426840, jitterRate=-0.02506411075592041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:37,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d6a1b2905ffe609f1a59ee214e4c06ed: 2023-07-24 13:07:37,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed., pid=70, masterSystemTime=1690204057543 2023-07-24 13:07:37,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:37,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:37,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90b6376aa60be0c26f7a3d3554f501e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74452304, jitterRate=0.10942578315734863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:37,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90b6376aa60be0c26f7a3d3554f501e2: 2023-07-24 13:07:37,569 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d6a1b2905ffe609f1a59ee214e4c06ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:37,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057569"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204057569"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204057569"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204057569"}]},"ts":"1690204057569"} 2023-07-24 13:07:37,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2., pid=69, masterSystemTime=1690204057533 2023-07-24 13:07:37,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:37,573 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=90b6376aa60be0c26f7a3d3554f501e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:37,573 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057573"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204057573"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204057573"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204057573"}]},"ts":"1690204057573"} 2023-07-24 13:07:37,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 13:07:37,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d6a1b2905ffe609f1a59ee214e4c06ed, server=jenkins-hbase4.apache.org,43445,1690203973024 in 189 msec 2023-07-24 13:07:37,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 13:07:37,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, ASSIGN in 356 msec 2023-07-24 13:07:37,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 90b6376aa60be0c26f7a3d3554f501e2, server=jenkins-hbase4.apache.org,37237,1690203973072 in 195 msec 2023-07-24 13:07:37,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-24 13:07:37,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, ASSIGN in 359 msec 2023-07-24 13:07:37,584 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:37,584 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204057584"}]},"ts":"1690204057584"} 2023-07-24 13:07:37,591 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 13:07:37,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:37,595 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 13:07:37,597 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 13:07:37,600 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:37,600 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:37,600 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:37,601 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:37,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,602 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,604 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,604 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:37,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 472 msec 2023-07-24 13:07:37,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:37,744 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 13:07:37,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d6a1b2905ffe609f1a59ee214e4c06ed, 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:37,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d6a1b2905ffe609f1a59ee214e4c06ed, 90b6376aa60be0c26f7a3d3554f501e2], force=true 2023-07-24 13:07:37,797 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d6a1b2905ffe609f1a59ee214e4c06ed, 90b6376aa60be0c26f7a3d3554f501e2], force=true 2023-07-24 13:07:37,797 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d6a1b2905ffe609f1a59ee214e4c06ed, 90b6376aa60be0c26f7a3d3554f501e2], force=true 2023-07-24 13:07:37,797 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d6a1b2905ffe609f1a59ee214e4c06ed, 90b6376aa60be0c26f7a3d3554f501e2], force=true 2023-07-24 13:07:37,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:37,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, UNASSIGN}] 2023-07-24 13:07:37,847 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, UNASSIGN 2023-07-24 13:07:37,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, UNASSIGN 2023-07-24 13:07:37,849 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=90b6376aa60be0c26f7a3d3554f501e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:37,849 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d6a1b2905ffe609f1a59ee214e4c06ed, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:37,849 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057849"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204057849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204057849"}]},"ts":"1690204057849"} 2023-07-24 13:07:37,850 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204057849"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204057849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204057849"}]},"ts":"1690204057849"} 2023-07-24 13:07:37,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 90b6376aa60be0c26f7a3d3554f501e2, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:37,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure d6a1b2905ffe609f1a59ee214e4c06ed, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:37,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:38,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:38,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:38,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90b6376aa60be0c26f7a3d3554f501e2, disabling compactions & flushes 2023-07-24 13:07:38,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:38,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:38,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. after waiting 0 ms 2023-07-24 13:07:38,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:38,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d6a1b2905ffe609f1a59ee214e4c06ed, disabling compactions & flushes 2023-07-24 13:07:38,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 90b6376aa60be0c26f7a3d3554f501e2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 13:07:38,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:38,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:38,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. after waiting 0 ms 2023-07-24 13:07:38,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:38,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d6a1b2905ffe609f1a59ee214e4c06ed 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 13:07:38,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/.tmp/cf/8252d9f13b174a34a61f29d485c5f00f 2023-07-24 13:07:38,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/.tmp/cf/f7ba942058174683aac8a8d6bfad9ee8 2023-07-24 13:07:38,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/.tmp/cf/8252d9f13b174a34a61f29d485c5f00f as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf/8252d9f13b174a34a61f29d485c5f00f 2023-07-24 13:07:38,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/.tmp/cf/f7ba942058174683aac8a8d6bfad9ee8 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf/f7ba942058174683aac8a8d6bfad9ee8 2023-07-24 13:07:38,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf/8252d9f13b174a34a61f29d485c5f00f, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 13:07:38,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 90b6376aa60be0c26f7a3d3554f501e2 in 63ms, sequenceid=5, compaction requested=false 2023-07-24 13:07:38,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 13:07:38,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf/f7ba942058174683aac8a8d6bfad9ee8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 13:07:38,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d6a1b2905ffe609f1a59ee214e4c06ed in 71ms, sequenceid=5, compaction requested=false 2023-07-24 13:07:38,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 13:07:38,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 13:07:38,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:38,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2. 2023-07-24 13:07:38,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90b6376aa60be0c26f7a3d3554f501e2: 2023-07-24 13:07:38,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:38,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed. 2023-07-24 13:07:38,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:38,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d6a1b2905ffe609f1a59ee214e4c06ed: 2023-07-24 13:07:38,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:38,109 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=90b6376aa60be0c26f7a3d3554f501e2, regionState=CLOSED 2023-07-24 13:07:38,109 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204058109"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204058109"}]},"ts":"1690204058109"} 2023-07-24 13:07:38,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:38,110 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d6a1b2905ffe609f1a59ee214e4c06ed, regionState=CLOSED 2023-07-24 13:07:38,110 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204058110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204058110"}]},"ts":"1690204058110"} 2023-07-24 13:07:38,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-24 13:07:38,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 90b6376aa60be0c26f7a3d3554f501e2, server=jenkins-hbase4.apache.org,37237,1690203973072 in 259 msec 2023-07-24 13:07:38,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-24 13:07:38,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure d6a1b2905ffe609f1a59ee214e4c06ed, server=jenkins-hbase4.apache.org,43445,1690203973024 in 268 msec 2023-07-24 13:07:38,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=90b6376aa60be0c26f7a3d3554f501e2, UNASSIGN in 279 msec 2023-07-24 13:07:38,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 13:07:38,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d6a1b2905ffe609f1a59ee214e4c06ed, UNASSIGN in 285 msec 2023-07-24 13:07:38,251 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 13:07:38,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057130.d6a1b2905ffe609f1a59ee214e4c06ed.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:38,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204057130.90b6376aa60be0c26f7a3d3554f501e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:38,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:38,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, ASSIGN}] 2023-07-24 13:07:38,310 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, ASSIGN 2023-07-24 13:07:38,311 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:07:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:38,461 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 13:07:38,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4c06bb4dca12b891b3ac923dd0bb830f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:38,463 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204058463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204058463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204058463"}]},"ts":"1690204058463"} 2023-07-24 13:07:38,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4c06bb4dca12b891b3ac923dd0bb830f, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:38,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:38,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c06bb4dca12b891b3ac923dd0bb830f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:07:38,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. service=AccessControlService 2023-07-24 13:07:38,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:38,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:38,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/.regioninfo 2023-07-24 13:07:38,638 INFO [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,639 DEBUG [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf 2023-07-24 13:07:38,640 DEBUG [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf 2023-07-24 13:07:38,640 INFO [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c06bb4dca12b891b3ac923dd0bb830f columnFamilyName cf 2023-07-24 13:07:38,673 DEBUG [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] regionserver.HStore(539): loaded hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/8252d9f13b174a34a61f29d485c5f00f.90b6376aa60be0c26f7a3d3554f501e2->hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf/8252d9f13b174a34a61f29d485c5f00f-top 2023-07-24 13:07:38,681 DEBUG [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] regionserver.HStore(539): loaded hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/f7ba942058174683aac8a8d6bfad9ee8.d6a1b2905ffe609f1a59ee214e4c06ed->hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf/f7ba942058174683aac8a8d6bfad9ee8-top 2023-07-24 13:07:38,682 INFO [StoreOpener-4c06bb4dca12b891b3ac923dd0bb830f-1] regionserver.HStore(310): Store=4c06bb4dca12b891b3ac923dd0bb830f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:38,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:38,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c06bb4dca12b891b3ac923dd0bb830f; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67439995, jitterRate=0.004934236407279968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:38,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c06bb4dca12b891b3ac923dd0bb830f: 2023-07-24 13:07:38,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f., pid=77, masterSystemTime=1690204058618 2023-07-24 13:07:38,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.,because compaction is disabled. 2023-07-24 13:07:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:38,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:38,692 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4c06bb4dca12b891b3ac923dd0bb830f, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:38,693 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204058692"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204058692"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204058692"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204058692"}]},"ts":"1690204058692"} 2023-07-24 13:07:38,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 13:07:38,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4c06bb4dca12b891b3ac923dd0bb830f, server=jenkins-hbase4.apache.org,43445,1690203973024 in 228 msec 2023-07-24 13:07:38,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 13:07:38,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, ASSIGN in 388 msec 2023-07-24 13:07:38,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d6a1b2905ffe609f1a59ee214e4c06ed, 90b6376aa60be0c26f7a3d3554f501e2], force=true in 920 msec 2023-07-24 13:07:38,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:38,911 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 13:07:38,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 13:07:38,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204058912 (current time:1690204058912). 2023-07-24 13:07:38,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:38,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x02446d21 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:38,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@620dd769, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:38,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:38,928 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:38,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02446d21 to 127.0.0.1:63130 2023-07-24 13:07:38,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:38,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x728db3c6 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5381f5d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:38,942 DEBUG [hconnection-0x5fbbd655-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:38,945 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:38,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:38,955 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:38,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x728db3c6 to 127.0.0.1:63130 2023-07-24 13:07:38,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:38,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 13:07:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 13:07:38,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 13:07:38,964 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 13:07:38,965 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690204658965 2023-07-24 13:07:38,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:38,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 13:07:38,969 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:38,969 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:38,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 13:07:38,971 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 13:07:38,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-24 13:07:38,974 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 13:07:38,977 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690204658977 2023-07-24 13:07:39,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,015 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 13:07:39,015 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:39,017 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 13:07:39,017 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 13:07:39,017 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,017 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,019 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:39,019 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:39,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:39,019 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,019 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:39,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:39,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:39,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:39,020 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,020 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 13:07:39,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 13:07:39,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,024 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 13:07:39,024 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 13:07:39,024 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:39,024 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:39,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,031 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 13:07:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 13:07:39,035 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 13:07:39,035 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 13:07:39,031 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 13:07:39,035 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 13:07:39,035 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 13:07:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 13:07:39,038 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 13:07:39,039 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 13:07:39,040 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,040 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,041 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:39,043 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,044 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:39,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 13:07:39,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67e8bc46[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:39,047 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 13:07:39,047 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,048 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,048 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 13:07:39,049 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 13:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:07:39,049 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 13:07:39,050 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:39,051 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:39,051 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:39,051 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. started... 2023-07-24 13:07:39,053 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4c06bb4dca12b891b3ac923dd0bb830f: 2023-07-24 13:07:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 13:07:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 13:07:39,053 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:39,053 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:39,053 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 13:07:39,055 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 13:07:39,055 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/8252d9f13b174a34a61f29d485c5f00f.90b6376aa60be0c26f7a3d3554f501e2->hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf/8252d9f13b174a34a61f29d485c5f00f-top, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/f7ba942058174683aac8a8d6bfad9ee8.d6a1b2905ffe609f1a59ee214e4c06ed->hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf/f7ba942058174683aac8a8d6bfad9ee8-top] hfiles 2023-07-24 13:07:39,055 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/8252d9f13b174a34a61f29d485c5f00f.90b6376aa60be0c26f7a3d3554f501e2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,060 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/f7ba942058174683aac8a8d6bfad9ee8.d6a1b2905ffe609f1a59ee214e4c06ed for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,069 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:39,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 13:07:39,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:39,071 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:39,105 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. completed. 2023-07-24 13:07:39,105 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:39,106 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,106 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 13:07:39,106 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:07:39,113 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,113 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 13:07:39,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:39,113 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:39,114 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 13:07:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:07:39,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 13:07:39,123 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 13:07:39,123 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:39,123 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:39,123 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,124 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:39,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:39,126 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,136 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:39,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:39,136 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,137 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,140 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,141 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,141 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,145 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:39,145 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:39,145 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:39,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:39,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:39,145 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:39,145 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,145 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:39,145 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:39,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:39,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:39,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:39,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,276 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:39,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 13:07:39,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:39,278 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:07:39,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 13:07:39,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,291 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690204058965Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204059145 (+180 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204059146 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204059152 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204059180 (+28 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690204059291 (+111 ms) 2023-07-24 13:07:39,295 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 13:07:39,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 327 msec 2023-07-24 13:07:39,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:39,578 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:39,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 13:07:39,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:39,581 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581 2023-07-24 13:07:39,581 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37143, tgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581, rawTgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:07:39,618 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:07:39,619 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_214498357_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,619 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 13:07:39,643 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:39,712 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:39,712 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:39,713 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:39,713 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:40,190 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:07:40,989 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-6692208209537364054.jar 2023-07-24 13:07:40,989 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:40,990 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,083 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-4063461730265670842.jar 2023-07-24 13:07:41,083 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,084 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,084 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,085 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,085 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,086 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:41,086 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:41,087 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:41,087 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:41,088 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:41,088 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:41,089 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:41,089 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:41,090 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:41,090 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:41,091 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:41,092 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:41,092 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:41,093 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:41,094 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:41,094 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:41,095 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:41,095 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:42,260 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:42,264 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 13:07:42,271 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 13:07:42,461 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:42,462 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:43,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:49,804 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:52,237 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:55,846 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:57,634 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:57,640 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:57,650 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,650 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:57,650 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:57,650 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,651 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 13:07:57,651 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 13:07:57,651 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,652 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 13:07:57,652 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204059581/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 13:07:57,658 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 13:07:57,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204077663"}]},"ts":"1690204077663"} 2023-07-24 13:07:57,665 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 13:07:57,667 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 13:07:57,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, UNASSIGN}] 2023-07-24 13:07:57,670 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, UNASSIGN 2023-07-24 13:07:57,673 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4c06bb4dca12b891b3ac923dd0bb830f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:57,673 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204077673"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204077673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204077673"}]},"ts":"1690204077673"} 2023-07-24 13:07:57,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4c06bb4dca12b891b3ac923dd0bb830f, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:57,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 13:07:57,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:57,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c06bb4dca12b891b3ac923dd0bb830f, disabling compactions & flushes 2023-07-24 13:07:57,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:57,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:57,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. after waiting 0 ms 2023-07-24 13:07:57,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:57,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 13:07:57,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:57,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f. 2023-07-24 13:07:57,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c06bb4dca12b891b3ac923dd0bb830f: 2023-07-24 13:07:57,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:57,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4c06bb4dca12b891b3ac923dd0bb830f, regionState=CLOSED 2023-07-24 13:07:57,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204077851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204077851"}]},"ts":"1690204077851"} 2023-07-24 13:07:57,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 13:07:57,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4c06bb4dca12b891b3ac923dd0bb830f, server=jenkins-hbase4.apache.org,43445,1690203973024 in 180 msec 2023-07-24 13:07:57,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 13:07:57,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4c06bb4dca12b891b3ac923dd0bb830f, UNASSIGN in 191 msec 2023-07-24 13:07:57,862 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204077862"}]},"ts":"1690204077862"} 2023-07-24 13:07:57,866 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 13:07:57,868 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 13:07:57,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 210 msec 2023-07-24 13:07:57,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 13:07:57,966 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 13:07:57,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,974 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,975 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,977 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,980 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,980 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 13:07:57,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 13:07:57,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 13:07:57,983 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:57,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 13:07:57,985 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 13:07:57,985 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:57,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:57,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:57,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:57,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 13:07:57,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:57,995 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:57,998 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:57,999 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:58,000 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/recovered.edits] 2023-07-24 13:07:58,001 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/recovered.edits] 2023-07-24 13:07:58,001 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/recovered.edits] 2023-07-24 13:07:58,011 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/8252d9f13b174a34a61f29d485c5f00f.90b6376aa60be0c26f7a3d3554f501e2 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/8252d9f13b174a34a61f29d485c5f00f.90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:58,012 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf/8252d9f13b174a34a61f29d485c5f00f to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/cf/8252d9f13b174a34a61f29d485c5f00f 2023-07-24 13:07:58,012 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf/f7ba942058174683aac8a8d6bfad9ee8 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/cf/f7ba942058174683aac8a8d6bfad9ee8 2023-07-24 13:07:58,014 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/f7ba942058174683aac8a8d6bfad9ee8.d6a1b2905ffe609f1a59ee214e4c06ed to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/cf/f7ba942058174683aac8a8d6bfad9ee8.d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:58,017 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/recovered.edits/8.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed/recovered.edits/8.seqid 2023-07-24 13:07:58,018 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d6a1b2905ffe609f1a59ee214e4c06ed 2023-07-24 13:07:58,020 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/recovered.edits/8.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2/recovered.edits/8.seqid 2023-07-24 13:07:58,021 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/90b6376aa60be0c26f7a3d3554f501e2 2023-07-24 13:07:58,024 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/recovered.edits/12.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f/recovered.edits/12.seqid 2023-07-24 13:07:58,024 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4c06bb4dca12b891b3ac923dd0bb830f 2023-07-24 13:07:58,024 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 13:07:58,028 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:58,033 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 13:07:58,035 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 13:07:58,036 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:58,037 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 13:07:58,037 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204078037"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:58,039 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 13:07:58,039 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4c06bb4dca12b891b3ac923dd0bb830f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204057131.4c06bb4dca12b891b3ac923dd0bb830f.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 13:07:58,039 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 13:07:58,039 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204078039"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:58,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 13:07:58,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:58,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 87 msec 2023-07-24 13:07:58,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 13:07:58,089 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 13:07:58,091 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 13:07:58,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204078096"}]},"ts":"1690204078096"} 2023-07-24 13:07:58,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 13:07:58,100 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 13:07:58,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, UNASSIGN}] 2023-07-24 13:07:58,104 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, UNASSIGN 2023-07-24 13:07:58,104 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, UNASSIGN 2023-07-24 13:07:58,105 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=776efa8750bfc2a100ff3d67794b07e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:07:58,106 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1f862f9af97ae00fc0529055cc83cfe4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:58,106 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204078105"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204078105"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204078105"}]},"ts":"1690204078105"} 2023-07-24 13:07:58,106 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204078106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204078106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204078106"}]},"ts":"1690204078106"} 2023-07-24 13:07:58,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 1f862f9af97ae00fc0529055cc83cfe4, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:58,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 776efa8750bfc2a100ff3d67794b07e5, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:07:58,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 13:07:58,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1f862f9af97ae00fc0529055cc83cfe4, disabling compactions & flushes 2023-07-24 13:07:58,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. after waiting 0 ms 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:58,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 776efa8750bfc2a100ff3d67794b07e5, disabling compactions & flushes 2023-07-24 13:07:58,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:58,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. after waiting 0 ms 2023-07-24 13:07:58,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:58,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:58,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:58,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4. 2023-07-24 13:07:58,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1f862f9af97ae00fc0529055cc83cfe4: 2023-07-24 13:07:58,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:58,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:58,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5. 2023-07-24 13:07:58,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 776efa8750bfc2a100ff3d67794b07e5: 2023-07-24 13:07:58,317 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=776efa8750bfc2a100ff3d67794b07e5, regionState=CLOSED 2023-07-24 13:07:58,317 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204078317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204078317"}]},"ts":"1690204078317"} 2023-07-24 13:07:58,318 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=1f862f9af97ae00fc0529055cc83cfe4, regionState=CLOSED 2023-07-24 13:07:58,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:58,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:58,318 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204078318"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204078318"}]},"ts":"1690204078318"} 2023-07-24 13:07:58,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-24 13:07:58,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 776efa8750bfc2a100ff3d67794b07e5, server=jenkins-hbase4.apache.org,37237,1690203973072 in 211 msec 2023-07-24 13:07:58,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-24 13:07:58,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 1f862f9af97ae00fc0529055cc83cfe4, server=jenkins-hbase4.apache.org,43445,1690203973024 in 212 msec 2023-07-24 13:07:58,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=776efa8750bfc2a100ff3d67794b07e5, UNASSIGN in 221 msec 2023-07-24 13:07:58,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-24 13:07:58,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1f862f9af97ae00fc0529055cc83cfe4, UNASSIGN in 222 msec 2023-07-24 13:07:58,326 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204078326"}]},"ts":"1690204078326"} 2023-07-24 13:07:58,331 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 13:07:58,334 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 13:07:58,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 244 msec 2023-07-24 13:07:58,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 13:07:58,400 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 13:07:58,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,404 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,405 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,410 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:58,410 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:58,412 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/recovered.edits] 2023-07-24 13:07:58,413 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/recovered.edits] 2023-07-24 13:07:58,415 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,418 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,418 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,418 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,418 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:58,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:58,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:58,419 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:58,420 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,420 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,420 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:58,420 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:58,421 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,421 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:58,421 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,421 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:58,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 13:07:58,423 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf/4e4bb3a361db4f1c8dcd11e033d8ccba to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/cf/4e4bb3a361db4f1c8dcd11e033d8ccba 2023-07-24 13:07:58,423 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf/636776f0c4144de69c137e6a573dd327 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/cf/636776f0c4144de69c137e6a573dd327 2023-07-24 13:07:58,427 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4/recovered.edits/9.seqid 2023-07-24 13:07:58,427 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5/recovered.edits/9.seqid 2023-07-24 13:07:58,427 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1f862f9af97ae00fc0529055cc83cfe4 2023-07-24 13:07:58,428 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/776efa8750bfc2a100ff3d67794b07e5 2023-07-24 13:07:58,428 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 13:07:58,428 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 13:07:58,429 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 13:07:58,434 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307244bcc661639144a768ef9383df87eccf9 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307244bcc661639144a768ef9383df87eccf9 2023-07-24 13:07:58,436 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f9774e7053e544538924f0707888f70e to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f9774e7053e544538924f0707888f70e 2023-07-24 13:07:58,436 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 13:07:58,439 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,442 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 13:07:58,444 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 13:07:58,446 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,446 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 13:07:58,446 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204078446"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:58,446 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204078446"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:58,448 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:07:58,448 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 776efa8750bfc2a100ff3d67794b07e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690204054886.776efa8750bfc2a100ff3d67794b07e5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1f862f9af97ae00fc0529055cc83cfe4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204054886.1f862f9af97ae00fc0529055cc83cfe4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:07:58,448 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 13:07:58,448 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204078448"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:58,449 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 13:07:58,452 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 51 msec 2023-07-24 13:07:58,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 13:07:58,524 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 13:07:58,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 13:07:58,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 13:07:58,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:58,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 13:07:58,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:58,609 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 745) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:46038 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:44138 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:41311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4106 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_542876105_1 at /127.0.0.1:46018 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:42466 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=895 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=503 (was 416) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 181), AvailableMemoryMB=5589 (was 5561) - AvailableMemoryMB LEAK? - 2023-07-24 13:07:58,609 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-24 13:07:58,640 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=503, ProcessCount=178, AvailableMemoryMB=5588 2023-07-24 13:07:58,641 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-24 13:07:58,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 13:07:58,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:07:58,646 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:58,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 13:07:58,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:58,647 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:58,650 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:58,650 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:58,651 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c empty. 2023-07-24 13:07:58,654 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f empty. 2023-07-24 13:07:58,655 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:58,656 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:58,656 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 13:07:58,698 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:58,699 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 496a9e547e44f267148037b3d6f4364c, NAME => 'testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:58,710 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f781cfcb0a8370094a63eb794d73ec6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:07:58,744 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:58,744 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 496a9e547e44f267148037b3d6f4364c, disabling compactions & flushes 2023-07-24 13:07:58,744 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:58,744 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:58,744 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. after waiting 0 ms 2023-07-24 13:07:58,744 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:58,744 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:58,744 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 496a9e547e44f267148037b3d6f4364c: 2023-07-24 13:07:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:58,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:59,151 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:59,151 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f781cfcb0a8370094a63eb794d73ec6f, disabling compactions & flushes 2023-07-24 13:07:59,151 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,151 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,151 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. after waiting 0 ms 2023-07-24 13:07:59,151 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,151 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,151 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f781cfcb0a8370094a63eb794d73ec6f: 2023-07-24 13:07:59,154 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:59,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204079156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204079156"}]},"ts":"1690204079156"} 2023-07-24 13:07:59,156 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204079156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204079156"}]},"ts":"1690204079156"} 2023-07-24 13:07:59,158 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:59,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:59,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204079160"}]},"ts":"1690204079160"} 2023-07-24 13:07:59,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 13:07:59,168 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:59,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:59,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:59,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:59,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:59,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, ASSIGN}] 2023-07-24 13:07:59,177 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, ASSIGN 2023-07-24 13:07:59,177 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, ASSIGN 2023-07-24 13:07:59,178 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41971,1690203972955; forceNewPlan=false, retain=false 2023-07-24 13:07:59,179 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:07:59,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:59,329 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:59,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f781cfcb0a8370094a63eb794d73ec6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:59,334 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=496a9e547e44f267148037b3d6f4364c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:59,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204079334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204079334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204079334"}]},"ts":"1690204079334"} 2023-07-24 13:07:59,335 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204079334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204079334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204079334"}]},"ts":"1690204079334"} 2023-07-24 13:07:59,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure f781cfcb0a8370094a63eb794d73ec6f, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:07:59,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 496a9e547e44f267148037b3d6f4364c, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:07:59,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f781cfcb0a8370094a63eb794d73ec6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:07:59,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. service=AccessControlService 2023-07-24 13:07:59,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:59,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:59,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 496a9e547e44f267148037b3d6f4364c, NAME => 'testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:07:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. service=AccessControlService 2023-07-24 13:07:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:59,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,513 INFO [StoreOpener-496a9e547e44f267148037b3d6f4364c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,514 INFO [StoreOpener-f781cfcb0a8370094a63eb794d73ec6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,515 DEBUG [StoreOpener-496a9e547e44f267148037b3d6f4364c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf 2023-07-24 13:07:59,516 DEBUG [StoreOpener-496a9e547e44f267148037b3d6f4364c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf 2023-07-24 13:07:59,516 DEBUG [StoreOpener-f781cfcb0a8370094a63eb794d73ec6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf 2023-07-24 13:07:59,516 INFO [StoreOpener-496a9e547e44f267148037b3d6f4364c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 496a9e547e44f267148037b3d6f4364c columnFamilyName cf 2023-07-24 13:07:59,516 DEBUG [StoreOpener-f781cfcb0a8370094a63eb794d73ec6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf 2023-07-24 13:07:59,517 INFO [StoreOpener-f781cfcb0a8370094a63eb794d73ec6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f781cfcb0a8370094a63eb794d73ec6f columnFamilyName cf 2023-07-24 13:07:59,518 INFO [StoreOpener-496a9e547e44f267148037b3d6f4364c-1] regionserver.HStore(310): Store=496a9e547e44f267148037b3d6f4364c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:59,518 INFO [StoreOpener-f781cfcb0a8370094a63eb794d73ec6f-1] regionserver.HStore(310): Store=f781cfcb0a8370094a63eb794d73ec6f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:59,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:07:59,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:07:59,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:59,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 496a9e547e44f267148037b3d6f4364c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65813101, jitterRate=-0.01930837333202362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:59,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 496a9e547e44f267148037b3d6f4364c: 2023-07-24 13:07:59,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c., pid=94, masterSystemTime=1690204079492 2023-07-24 13:07:59,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:59,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:59,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:59,530 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=496a9e547e44f267148037b3d6f4364c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:07:59,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f781cfcb0a8370094a63eb794d73ec6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64352527, jitterRate=-0.04107262194156647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:59,530 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204079530"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204079530"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204079530"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204079530"}]},"ts":"1690204079530"} 2023-07-24 13:07:59,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f781cfcb0a8370094a63eb794d73ec6f: 2023-07-24 13:07:59,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f., pid=93, masterSystemTime=1690204079491 2023-07-24 13:07:59,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:07:59,533 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=f781cfcb0a8370094a63eb794d73ec6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:07:59,533 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204079533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204079533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204079533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204079533"}]},"ts":"1690204079533"} 2023-07-24 13:07:59,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 13:07:59,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 496a9e547e44f267148037b3d6f4364c, server=jenkins-hbase4.apache.org,41971,1690203972955 in 194 msec 2023-07-24 13:07:59,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, ASSIGN in 364 msec 2023-07-24 13:07:59,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 13:07:59,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure f781cfcb0a8370094a63eb794d73ec6f, server=jenkins-hbase4.apache.org,43445,1690203973024 in 197 msec 2023-07-24 13:07:59,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 13:07:59,543 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, ASSIGN in 370 msec 2023-07-24 13:07:59,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:59,543 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204079543"}]},"ts":"1690204079543"} 2023-07-24 13:07:59,545 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 13:07:59,548 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:59,548 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 13:07:59,550 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:07:59,552 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:59,552 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:59,552 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:59,552 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:59,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:59,554 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:59,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:59,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:59,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 912 msec 2023-07-24 13:07:59,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:59,755 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 13:07:59,761 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 13:07:59,761 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:07:59,763 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:59,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:59,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204079780 (current time:1690204079780). 2023-07-24 13:07:59,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:59,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x165e21f2 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:59,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@169cfa8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:59,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:59,800 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:59,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x165e21f2 to 127.0.0.1:63130 2023-07-24 13:07:59,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:59,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x1f51e86d to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:59,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78670bc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:59,919 DEBUG [hconnection-0x95ed6de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:59,924 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:59,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:59,938 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:59,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f51e86d to 127.0.0.1:63130 2023-07-24 13:07:59,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:59,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:07:59,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:59,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:59,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:59,956 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:59,957 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204679957 2023-07-24 13:07:59,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:59,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 13:07:59,960 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:59,960 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:59,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:59,962 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:59,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 16 msec 2023-07-24 13:07:59,973 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:59,974 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204679974 2023-07-24 13:07:59,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:59,995 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 13:07:59,995 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:59,997 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 13:07:59,997 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:07:59,997 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:59,997 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,006 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,006 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,006 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,009 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,009 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,009 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,009 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:08:00,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,007 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 13:08:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,011 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:08:00,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,018 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:08:00,018 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,020 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:08:00,022 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:08:00,022 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:08:00,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 13:08:00,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:08:00,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,028 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:08:00,028 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,036 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:08:00,036 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:08:00,036 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:08:00,036 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,037 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,037 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:00,038 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,039 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,039 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 13:08:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:08:00,039 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:08:00,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a9e0ac[Count = 1] remaining members to acquire global barrier 2023-07-24 13:08:00,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,053 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:08:00,053 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,055 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:08:00,055 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:08:00,055 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:08:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,057 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,058 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,060 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:00,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:08:00,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a9e0ac[Count = 0] remaining members to acquire global barrier 2023-07-24 13:08:00,060 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:08:00,060 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:08:00,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:00,061 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:08:00,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:08:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:08:00,063 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:08:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,063 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:08:00,064 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,064 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:08:00,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:00,065 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:08:00,065 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. started... 2023-07-24 13:08:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:08:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:08:00,067 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:00,067 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:00,070 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:00,070 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. started... 2023-07-24 13:08:00,074 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 496a9e547e44f267148037b3d6f4364c: 2023-07-24 13:08:00,074 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,074 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:00,074 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:08:00,075 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f781cfcb0a8370094a63eb794d73ec6f: 2023-07-24 13:08:00,075 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,076 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:00,076 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:08:00,114 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. completed. 2023-07-24 13:08:00,114 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:00,114 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:00,114 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:00,114 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,114 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:08:00,114 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:08:00,121 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:08:00,121 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,121 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,121 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:08:00,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41971,1690203972955': 2023-07-24 13:08:00,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:08:00,143 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. completed. 2023-07-24 13:08:00,143 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:08:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:08:00,146 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:08:00,146 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,146 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:08:00,146 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:08:00,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:08:00,155 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 13:08:00,155 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:08:00,155 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:08:00,155 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,155 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:08:00,158 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,158 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,158 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,158 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,162 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,162 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,163 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,174 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,175 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,176 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,178 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,179 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,179 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,185 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 13:08:00,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,189 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,190 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,190 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,190 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,185 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,189 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,190 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,189 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,190 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 13:08:00,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,262 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:00,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:08:00,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:00,264 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:08:00,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 13:08:00,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,366 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690204079958Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690204080241 (+283 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690204080241Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690204080241Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690204080287 (+46 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690204080303 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690204080364 (+61 ms) 2023-07-24 13:08:00,370 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:08:00,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 410 msec 2023-07-24 13:08:00,564 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:00,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:08:00,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:08:00,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41971] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:08:00,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:08:00,575 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 13:08:00,575 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:00,576 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:08:00,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:08:00,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204080589 (current time:1690204080589). 2023-07-24 13:08:00,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:08:00,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x58799e71 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:00,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276e5b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:00,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:00,620 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:00,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58799e71 to 127.0.0.1:63130 2023-07-24 13:08:00,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:00,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x2377be1f to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:00,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37692616, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:00,671 DEBUG [hconnection-0x620ee916-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:00,672 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:00,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:00,680 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:00,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2377be1f to 127.0.0.1:63130 2023-07-24 13:08:00,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:00,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:08:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:08:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:08:00,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:08:00,688 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:08:00,689 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204680689 2023-07-24 13:08:00,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:08:00,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 13:08:00,695 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:08:00,695 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:08:00,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:08:00,697 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:08:00,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-24 13:08:00,705 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:08:00,705 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204680705 2023-07-24 13:08:00,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,717 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 13:08:00,717 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,719 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 13:08:00,719 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:08:00,789 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,789 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,795 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:00,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:08:00,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:00,797 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:08:00,799 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,799 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,799 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,799 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,800 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,800 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 13:08:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,805 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,805 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:08:00,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:08:00,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:08:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:08:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:08:00,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:00,813 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:08:00,817 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:08:00,817 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:08:00,817 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:08:00,819 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,819 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,821 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,821 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:00,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d3fdba3[Count = 1] remaining members to acquire global barrier 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:08:00,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d3fdba3[Count = 0] remaining members to acquire global barrier 2023-07-24 13:08:00,833 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:08:00,833 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:08:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:08:00,838 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:08:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:08:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:00,839 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:00,839 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:00,838 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:08:00,839 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. started... 2023-07-24 13:08:00,839 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. started... 2023-07-24 13:08:00,839 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,839 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:08:00,839 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:00,839 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 496a9e547e44f267148037b3d6f4364c 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 13:08:00,839 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f781cfcb0a8370094a63eb794d73ec6f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 13:08:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:08:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,840 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:08:00,903 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307249860344b8ae94eb4bd6b7f923f6eb8f2 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307249860344b8ae94eb4bd6b7f923f6eb8f2 2023-07-24 13:08:00,922 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/.tmp/cf/dea16134d1f042f381fda05c376c4aa2 2023-07-24 13:08:00,922 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072476f960e0b2e247ad8eb84c99385936c4 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072476f960e0b2e247ad8eb84c99385936c4 2023-07-24 13:08:00,932 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/.tmp/cf/dea16134d1f042f381fda05c376c4aa2 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf/dea16134d1f042f381fda05c376c4aa2 2023-07-24 13:08:00,937 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/.tmp/cf/946803308cfb41ea8493adaf276ca78a 2023-07-24 13:08:00,938 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf/dea16134d1f042f381fda05c376c4aa2, entries=5, sequenceid=6, filesize=5.8 K 2023-07-24 13:08:00,939 INFO [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 496a9e547e44f267148037b3d6f4364c in 100ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:00,939 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 13:08:00,939 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 496a9e547e44f267148037b3d6f4364c: 2023-07-24 13:08:00,940 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,940 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:00,940 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf/dea16134d1f042f381fda05c376c4aa2] hfiles 2023-07-24 13:08:00,940 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf/dea16134d1f042f381fda05c376c4aa2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,945 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/.tmp/cf/946803308cfb41ea8493adaf276ca78a as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf/946803308cfb41ea8493adaf276ca78a 2023-07-24 13:08:00,951 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf/946803308cfb41ea8493adaf276ca78a, entries=45, sequenceid=6, filesize=12.7 K 2023-07-24 13:08:00,952 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. completed. 2023-07-24 13:08:00,952 DEBUG [rs(jenkins-hbase4.apache.org,41971,1690203972955)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:08:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:08:00,953 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for f781cfcb0a8370094a63eb794d73ec6f in 114ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:00,954 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f781cfcb0a8370094a63eb794d73ec6f: 2023-07-24 13:08:00,955 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:08:00,955 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:00,955 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,955 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf/946803308cfb41ea8493adaf276ca78a] hfiles 2023-07-24 13:08:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,955 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf/946803308cfb41ea8493adaf276ca78a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:08:00,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41971,1690203972955': 2023-07-24 13:08:00,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:08:00,966 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. completed. 2023-07-24 13:08:00,966 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:00,967 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:00,967 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:00,967 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,967 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:08:00,967 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:08:00,969 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:08:00,969 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,969 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,970 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:08:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:08:00,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:08:00,978 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 13:08:00,979 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:08:00,979 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:08:00,979 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,979 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:08:00,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,981 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,982 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:00,983 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,984 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,984 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:00,986 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,987 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,987 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:00,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:00,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,991 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:00,992 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:00,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,991 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:00,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,994 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,994 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:00,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:00,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:00,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072476f960e0b2e247ad8eb84c99385936c4, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307249860344b8ae94eb4bd6b7f923f6eb8f2] mob files 2023-07-24 13:08:00,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072476f960e0b2e247ad8eb84c99385936c4 2023-07-24 13:08:00,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307249860344b8ae94eb4bd6b7f923f6eb8f2 2023-07-24 13:08:00,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,997 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:08:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:00,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:00,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:00,999 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:08:01,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 13:08:01,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,050 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690204080689Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690204081003 (+314 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690204081003Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690204081003Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690204081007 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690204081016 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690204081050 (+34 ms) 2023-07-24 13:08:01,055 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:08:01,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 364 msec 2023-07-24 13:08:01,299 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:01,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:08:01,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:08:01,300 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300 2023-07-24 13:08:01,301 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37143, tgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300, rawTgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:08:01,332 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:08:01,332 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_65809700_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,332 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 13:08:01,343 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:01,408 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:01,409 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:01,409 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:01,409 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,001 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0005_000001 (auth:SIMPLE) 2023-07-24 13:08:02,631 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-5974316523810460675.jar 2023-07-24 13:08:02,631 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,632 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,716 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-7127580856001642270.jar 2023-07-24 13:08:02,716 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,717 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,717 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,718 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,718 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,719 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:02,719 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:08:02,720 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:08:02,720 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:08:02,721 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:08:02,721 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:08:02,722 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:08:02,722 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:08:02,723 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:08:02,723 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:08:02,724 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:08:02,725 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:02,726 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:02,726 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:02,727 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:02,727 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:02,728 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:02,728 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:03,464 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:08:05,437 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:08:05,446 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 13:08:05,628 WARN [DataStreamer for file /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1690203982289_0006/job.xml] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-24 13:08:05,660 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:08:05,660 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:08:06,006 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0006_000001 (auth:SIMPLE) 2023-07-24 13:08:11,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0006_000001 (auth:SIMPLE) 2023-07-24 13:08:13,801 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:08:13,803 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:08:13,822 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:13,822 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:08:13,823 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:08:13,823 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:13,824 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 13:08:13,824 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 13:08:13,824 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:13,824 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 13:08:13,824 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204081300/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 13:08:13,831 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 13:08:13,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 13:08:13,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:13,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 13:08:13,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204093836"}]},"ts":"1690204093836"} 2023-07-24 13:08:13,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 13:08:13,842 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 13:08:13,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, UNASSIGN}] 2023-07-24 13:08:13,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, UNASSIGN 2023-07-24 13:08:13,850 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, UNASSIGN 2023-07-24 13:08:13,850 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f781cfcb0a8370094a63eb794d73ec6f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:13,850 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=496a9e547e44f267148037b3d6f4364c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:13,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204093850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204093850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204093850"}]},"ts":"1690204093850"} 2023-07-24 13:08:13,851 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204093850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204093850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204093850"}]},"ts":"1690204093850"} 2023-07-24 13:08:13,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure f781cfcb0a8370094a63eb794d73ec6f, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:08:13,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 496a9e547e44f267148037b3d6f4364c, server=jenkins-hbase4.apache.org,41971,1690203972955}] 2023-07-24 13:08:13,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 13:08:14,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:08:14,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 496a9e547e44f267148037b3d6f4364c, disabling compactions & flushes 2023-07-24 13:08:14,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:14,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. after waiting 0 ms 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f781cfcb0a8370094a63eb794d73ec6f, disabling compactions & flushes 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:14,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. after waiting 0 ms 2023-07-24 13:08:14,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:14,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:14,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:14,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f. 2023-07-24 13:08:14,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f781cfcb0a8370094a63eb794d73ec6f: 2023-07-24 13:08:14,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:08:14,089 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=f781cfcb0a8370094a63eb794d73ec6f, regionState=CLOSED 2023-07-24 13:08:14,089 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204094089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204094089"}]},"ts":"1690204094089"} 2023-07-24 13:08:14,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-24 13:08:14,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure f781cfcb0a8370094a63eb794d73ec6f, server=jenkins-hbase4.apache.org,43445,1690203973024 in 248 msec 2023-07-24 13:08:14,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f781cfcb0a8370094a63eb794d73ec6f, UNASSIGN in 256 msec 2023-07-24 13:08:14,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:14,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:14,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c. 2023-07-24 13:08:14,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 496a9e547e44f267148037b3d6f4364c: 2023-07-24 13:08:14,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 496a9e547e44f267148037b3d6f4364c 2023-07-24 13:08:14,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=496a9e547e44f267148037b3d6f4364c, regionState=CLOSED 2023-07-24 13:08:14,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204094111"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204094111"}]},"ts":"1690204094111"} 2023-07-24 13:08:14,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-24 13:08:14,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 496a9e547e44f267148037b3d6f4364c, server=jenkins-hbase4.apache.org,41971,1690203972955 in 265 msec 2023-07-24 13:08:14,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 13:08:14,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=496a9e547e44f267148037b3d6f4364c, UNASSIGN in 275 msec 2023-07-24 13:08:14,131 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204094130"}]},"ts":"1690204094130"} 2023-07-24 13:08:14,133 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 13:08:14,135 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 13:08:14,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 304 msec 2023-07-24 13:08:14,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 13:08:14,139 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 13:08:14,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,144 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,145 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,147 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,151 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:14,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:14,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:14,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,153 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 13:08:14,166 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:08:14,167 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c 2023-07-24 13:08:14,170 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/recovered.edits] 2023-07-24 13:08:14,171 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/recovered.edits] 2023-07-24 13:08:14,177 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf/dea16134d1f042f381fda05c376c4aa2 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/cf/dea16134d1f042f381fda05c376c4aa2 2023-07-24 13:08:14,180 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf/946803308cfb41ea8493adaf276ca78a to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/cf/946803308cfb41ea8493adaf276ca78a 2023-07-24 13:08:14,184 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c/recovered.edits/9.seqid 2023-07-24 13:08:14,185 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/496a9e547e44f267148037b3d6f4364c 2023-07-24 13:08:14,185 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f/recovered.edits/9.seqid 2023-07-24 13:08:14,186 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testEmptyExportFileSystemState/f781cfcb0a8370094a63eb794d73ec6f 2023-07-24 13:08:14,186 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 13:08:14,187 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 13:08:14,191 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 13:08:14,198 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072476f960e0b2e247ad8eb84c99385936c4 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072476f960e0b2e247ad8eb84c99385936c4 2023-07-24 13:08:14,211 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307249860344b8ae94eb4bd6b7f923f6eb8f2 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307249860344b8ae94eb4bd6b7f923f6eb8f2 2023-07-24 13:08:14,211 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 13:08:14,215 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,218 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 13:08:14,220 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 13:08:14,222 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,222 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 13:08:14,222 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204094222"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:14,222 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204094222"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:14,233 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:08:14,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 496a9e547e44f267148037b3d6f4364c, NAME => 'testtb-testEmptyExportFileSystemState,,1690204078642.496a9e547e44f267148037b3d6f4364c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f781cfcb0a8370094a63eb794d73ec6f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690204078642.f781cfcb0a8370094a63eb794d73ec6f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:08:14,233 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 13:08:14,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204094233"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:14,236 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 13:08:14,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:14,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 98 msec 2023-07-24 13:08:14,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 13:08:14,256 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 13:08:14,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 13:08:14,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:14,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 13:08:14,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:14,322 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 756) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:45895 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1594707073_1 at /127.0.0.1:54514 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:54534 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4793 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:46137 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:36958 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_65809700_17 at /127.0.0.1:33222 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:45009 from appattempt_1690203982289_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=602 (was 503) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 178), AvailableMemoryMB=5643 (was 5588) - AvailableMemoryMB LEAK? - 2023-07-24 13:08:14,322 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 13:08:14,351 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=602, ProcessCount=178, AvailableMemoryMB=5642 2023-07-24 13:08:14,351 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 13:08:14,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 13:08:14,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:14,366 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:08:14,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 13:08:14,369 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:08:14,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:14,388 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,388 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,389 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 empty. 2023-07-24 13:08:14,389 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e empty. 2023-07-24 13:08:14,389 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,389 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,389 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 13:08:14,411 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 13:08:14,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4e7b6eff6591904126e5163225fa39a2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:08:14,425 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 37a613a8ab49bafcbc5335c4e52f980e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp 2023-07-24 13:08:14,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:14,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 37a613a8ab49bafcbc5335c4e52f980e, disabling compactions & flushes 2023-07-24 13:08:14,477 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. after waiting 0 ms 2023-07-24 13:08:14,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,477 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,477 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 37a613a8ab49bafcbc5335c4e52f980e: 2023-07-24 13:08:14,478 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:14,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4e7b6eff6591904126e5163225fa39a2, disabling compactions & flushes 2023-07-24 13:08:14,479 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. after waiting 0 ms 2023-07-24 13:08:14,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,479 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,479 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4e7b6eff6591904126e5163225fa39a2: 2023-07-24 13:08:14,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:14,481 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:08:14,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204094482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204094482"}]},"ts":"1690204094482"} 2023-07-24 13:08:14,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204094482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204094482"}]},"ts":"1690204094482"} 2023-07-24 13:08:14,503 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:08:14,504 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:08:14,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204094504"}]},"ts":"1690204094504"} 2023-07-24 13:08:14,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 13:08:14,510 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:08:14,512 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:08:14,512 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:08:14,512 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:08:14,512 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:08:14,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, ASSIGN}] 2023-07-24 13:08:14,515 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, ASSIGN 2023-07-24 13:08:14,515 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, ASSIGN 2023-07-24 13:08:14,516 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43445,1690203973024; forceNewPlan=false, retain=false 2023-07-24 13:08:14,516 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37237,1690203973072; forceNewPlan=false, retain=false 2023-07-24 13:08:14,667 INFO [jenkins-hbase4:39637] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:08:14,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=37a613a8ab49bafcbc5335c4e52f980e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:14,670 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4e7b6eff6591904126e5163225fa39a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:14,670 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204094670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204094670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204094670"}]},"ts":"1690204094670"} 2023-07-24 13:08:14,670 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204094670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204094670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204094670"}]},"ts":"1690204094670"} 2023-07-24 13:08:14,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 37a613a8ab49bafcbc5335c4e52f980e, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:08:14,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 4e7b6eff6591904126e5163225fa39a2, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:08:14,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:14,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37a613a8ab49bafcbc5335c4e52f980e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:08:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. service=AccessControlService 2023-07-24 13:08:14,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:08:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,838 INFO [StoreOpener-37a613a8ab49bafcbc5335c4e52f980e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e7b6eff6591904126e5163225fa39a2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:08:14,840 DEBUG [StoreOpener-37a613a8ab49bafcbc5335c4e52f980e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf 2023-07-24 13:08:14,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. service=AccessControlService 2023-07-24 13:08:14,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:08:14,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:14,840 DEBUG [StoreOpener-37a613a8ab49bafcbc5335c4e52f980e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf 2023-07-24 13:08:14,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,841 INFO [StoreOpener-37a613a8ab49bafcbc5335c4e52f980e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37a613a8ab49bafcbc5335c4e52f980e columnFamilyName cf 2023-07-24 13:08:14,843 INFO [StoreOpener-37a613a8ab49bafcbc5335c4e52f980e-1] regionserver.HStore(310): Store=37a613a8ab49bafcbc5335c4e52f980e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:08:14,852 INFO [StoreOpener-4e7b6eff6591904126e5163225fa39a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,855 DEBUG [StoreOpener-4e7b6eff6591904126e5163225fa39a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf 2023-07-24 13:08:14,855 DEBUG [StoreOpener-4e7b6eff6591904126e5163225fa39a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf 2023-07-24 13:08:14,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:14,856 INFO [StoreOpener-4e7b6eff6591904126e5163225fa39a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e7b6eff6591904126e5163225fa39a2 columnFamilyName cf 2023-07-24 13:08:14,857 INFO [StoreOpener-4e7b6eff6591904126e5163225fa39a2-1] regionserver.HStore(310): Store=4e7b6eff6591904126e5163225fa39a2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:08:14,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:08:14,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 37a613a8ab49bafcbc5335c4e52f980e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62322914, jitterRate=-0.07131621241569519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:08:14,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 37a613a8ab49bafcbc5335c4e52f980e: 2023-07-24 13:08:14,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e., pid=108, masterSystemTime=1690204094826 2023-07-24 13:08:14,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:14,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:14,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=37a613a8ab49bafcbc5335c4e52f980e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:14,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204094865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204094865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204094865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204094865"}]},"ts":"1690204094865"} 2023-07-24 13:08:14,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:08:14,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e7b6eff6591904126e5163225fa39a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71957512, jitterRate=0.07225048542022705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:08:14,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e7b6eff6591904126e5163225fa39a2: 2023-07-24 13:08:14,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2., pid=109, masterSystemTime=1690204094826 2023-07-24 13:08:14,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,872 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4e7b6eff6591904126e5163225fa39a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:14,872 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204094872"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204094872"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204094872"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204094872"}]},"ts":"1690204094872"} 2023-07-24 13:08:14,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 13:08:14,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 37a613a8ab49bafcbc5335c4e52f980e, server=jenkins-hbase4.apache.org,43445,1690203973024 in 196 msec 2023-07-24 13:08:14,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, ASSIGN in 363 msec 2023-07-24 13:08:14,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 13:08:14,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 4e7b6eff6591904126e5163225fa39a2, server=jenkins-hbase4.apache.org,37237,1690203973072 in 201 msec 2023-07-24 13:08:14,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 13:08:14,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, ASSIGN in 366 msec 2023-07-24 13:08:14,881 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:08:14,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204094881"}]},"ts":"1690204094881"} 2023-07-24 13:08:14,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 13:08:14,885 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:08:14,886 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 13:08:14,890 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 13:08:14,892 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,892 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,892 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,892 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:14,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:14,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:14,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:14,896 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:14,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 543 msec 2023-07-24 13:08:14,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:14,984 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 13:08:14,997 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:14,997 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:14,999 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:08:15,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:15,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204095049 (current time:1690204095049). 2023-07-24 13:08:15,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:08:15,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x556a755e to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:15,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3deb4d43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:15,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:15,095 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x556a755e to 127.0.0.1:63130 2023-07-24 13:08:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x7afd1df0 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:15,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cbb4774, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:15,155 DEBUG [hconnection-0x1b5d9cf5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:15,159 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:15,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:15,170 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:15,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7afd1df0 to 127.0.0.1:63130 2023-07-24 13:08:15,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:15,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 13:08:15,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:08:15,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:15,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:15,176 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:15,177 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690204695177 2023-07-24 13:08:15,177 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:15,179 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:08:15,179 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:08:15,180 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:15,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:15,182 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-24 13:08:15,183 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:15,183 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690204695183 2023-07-24 13:08:15,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,239 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 13:08:15,239 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,241 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 13:08:15,241 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 13:08:15,242 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,242 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,243 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,243 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 13:08:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,245 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 13:08:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,245 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:15,245 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,245 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,246 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,246 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,246 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,246 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:08:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 13:08:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:15,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,252 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:15,252 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,252 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:15,252 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:15,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:15,276 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,278 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:15,278 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:15,278 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:15,279 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:15,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:15,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:15,280 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:08:15,284 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,285 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,285 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,285 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,285 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:15,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@449f922c[Count = 1] remaining members to acquire global barrier 2023-07-24 13:08:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:15,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@449f922c[Count = 0] remaining members to acquire global barrier 2023-07-24 13:08:15,293 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 13:08:15,293 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,294 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:15,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,295 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,295 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:15,295 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:15,302 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,302 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,302 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:15,302 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. started... 2023-07-24 13:08:15,302 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:08:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,302 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:15,302 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:15,302 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:08:15,303 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:15,303 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:15,303 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:15,303 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. started... 2023-07-24 13:08:15,306 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:15,306 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:15,306 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:15,308 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e7b6eff6591904126e5163225fa39a2: 2023-07-24 13:08:15,308 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37a613a8ab49bafcbc5335c4e52f980e: 2023-07-24 13:08:15,309 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,309 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:15,309 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:08:15,308 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,309 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:15,309 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:08:15,349 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. completed. 2023-07-24 13:08:15,350 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:15,350 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. completed. 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:15,350 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:15,350 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:08:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:15,353 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:15,353 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:15,353 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,355 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:15,355 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:15,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:08:15,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 13:08:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:08:15,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 13:08:15,371 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 13:08:15,371 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:08:15,371 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:08:15,372 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,372 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:08:15,377 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,377 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,377 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:15,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:15,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:15,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,379 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,379 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,379 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,379 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:15,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,379 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:15,380 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,381 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:15,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,383 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,383 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,384 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,387 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,387 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,387 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,388 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:15,387 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,388 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:15,387 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,388 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:15,388 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:15,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:08:15,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:15,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:15,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:15,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:15,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 13:08:15,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:15,388 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,393 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,480 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:15,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:15,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:15,482 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:08:15,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 13:08:15,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,583 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690204095177Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690204095403 (+226 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204095403Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204095403Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204095415 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204095454 (+39 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690204095583 (+129 ms) 2023-07-24 13:08:15,586 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:15,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 409 msec 2023-07-24 13:08:15,782 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:15,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:15,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:08:15,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37237] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:08:15,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43445] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:08:15,790 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,790 DEBUG [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:15,790 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:08:15,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204095800 (current time:1690204095800). 2023-07-24 13:08:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:08:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x47e10959 to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:15,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30ac8f64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:15,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:15,810 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47e10959 to 127.0.0.1:63130 2023-07-24 13:08:15,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:15,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(139): Connect 0x263227ca to 127.0.0.1:63130 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:15,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69d65994, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:15,821 DEBUG [hconnection-0x3dd53c65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:15,825 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:15,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:15,833 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:15,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x263227ca to 127.0.0.1:63130 2023-07-24 13:08:15,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:15,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 13:08:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:08:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:15,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:15,839 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:15,839 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690204695839 2023-07-24 13:08:15,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:15,839 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,841 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:08:15,841 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:08:15,844 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:15,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:15,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-24 13:08:15,848 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:15,849 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690204695849 2023-07-24 13:08:15,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,867 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 13:08:15,868 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,869 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 13:08:15,869 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 13:08:15,870 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,870 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,872 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,872 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,872 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,872 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:15,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:15,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:15,872 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,872 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,875 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:15,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:15,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:15,876 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:15,878 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:15,882 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41971,1690203972955' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:15,884 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,884 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,884 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:15,885 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:15,886 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,886 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:15,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43445,1690203973024' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b70c75[Count = 1] remaining members to acquire global barrier 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:15,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37237,1690203973072' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:15,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b70c75[Count = 0] remaining members to acquire global barrier 2023-07-24 13:08:15,891 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 13:08:15,891 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:15,896 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:15,896 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:15,896 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:15,896 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:15,896 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:15,897 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:15,896 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. started... 2023-07-24 13:08:15,896 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:15,897 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:15,897 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41971,1690203972955' in zk 2023-07-24 13:08:15,897 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. started... 2023-07-24 13:08:15,897 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:08:15,897 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4e7b6eff6591904126e5163225fa39a2 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-24 13:08:15,897 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 37a613a8ab49bafcbc5335c4e52f980e 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-24 13:08:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:15,900 DEBUG [member: 'jenkins-hbase4.apache.org,41971,1690203972955' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:15,931 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724b65137dd216c48e587e6fd44977269a2 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724b65137dd216c48e587e6fd44977269a2 2023-07-24 13:08:15,934 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724ab224dbfee40480a8116cc3635ed7af7 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724ab224dbfee40480a8116cc3635ed7af7 2023-07-24 13:08:15,941 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:15,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:15,943 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:08:15,981 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=534, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/.tmp/cf/7cce194c819d447eaa8300597cad92be 2023-07-24 13:08:15,981 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/.tmp/cf/5100253d84e44707be8e93eac6a2d233 2023-07-24 13:08:15,988 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/.tmp/cf/5100253d84e44707be8e93eac6a2d233 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf/5100253d84e44707be8e93eac6a2d233 2023-07-24 13:08:15,990 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/.tmp/cf/7cce194c819d447eaa8300597cad92be as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf/7cce194c819d447eaa8300597cad92be 2023-07-24 13:08:15,999 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf/5100253d84e44707be8e93eac6a2d233, entries=42, sequenceid=6, filesize=12.5 K 2023-07-24 13:08:16,001 INFO [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 37a613a8ab49bafcbc5335c4e52f980e in 104ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:16,001 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 13:08:16,002 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf/7cce194c819d447eaa8300597cad92be, entries=8, sequenceid=6, filesize=6.3 K 2023-07-24 13:08:16,002 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 37a613a8ab49bafcbc5335c4e52f980e: 2023-07-24 13:08:16,002 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,002 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:16,002 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf/5100253d84e44707be8e93eac6a2d233] hfiles 2023-07-24 13:08:16,002 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf/5100253d84e44707be8e93eac6a2d233 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,002 INFO [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4e7b6eff6591904126e5163225fa39a2 in 105ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:16,004 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e7b6eff6591904126e5163225fa39a2: 2023-07-24 13:08:16,004 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,004 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:16,005 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf/7cce194c819d447eaa8300597cad92be] hfiles 2023-07-24 13:08:16,005 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf/7cce194c819d447eaa8300597cad92be for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,023 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. completed. 2023-07-24 13:08:16,023 DEBUG [rs(jenkins-hbase4.apache.org,37237,1690203973072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:16,023 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:16,023 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:16,024 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,024 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:16,024 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37237,1690203973072' in zk 2023-07-24 13:08:16,026 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:16,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:16,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:16,026 DEBUG [member: 'jenkins-hbase4.apache.org,37237,1690203973072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:16,028 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. completed. 2023-07-24 13:08:16,028 DEBUG [rs(jenkins-hbase4.apache.org,43445,1690203973024)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:16,028 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:16,028 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:16,028 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:16,028 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:16,028 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43445,1690203973024' in zk 2023-07-24 13:08:16,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:16,030 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,030 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:16,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,030 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:16,030 DEBUG [member: 'jenkins-hbase4.apache.org,43445,1690203973024' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:16,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:16,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37237,1690203973072': 2023-07-24 13:08:16,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37237,1690203973072' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 13:08:16,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:16,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:16,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:16,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:16,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:16,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43445,1690203973024': 2023-07-24 13:08:16,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43445,1690203973024' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 13:08:16,042 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 13:08:16,042 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:08:16,042 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:08:16,042 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,042 INFO [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:16,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:16,045 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:16,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:16,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:16,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:16,046 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,047 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,048 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:16,050 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,050 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,050 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:16,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:16,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:16,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:16,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,056 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:16,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:16,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 13:08:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:16,057 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:16,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:16,057 DEBUG [(jenkins-hbase4.apache.org,39637,1690203971407)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:16,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:16,058 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:16,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:16,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724ab224dbfee40480a8116cc3635ed7af7, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724b65137dd216c48e587e6fd44977269a2] mob files 2023-07-24 13:08:16,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:16,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724ab224dbfee40480a8116cc3635ed7af7 2023-07-24 13:08:16,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:08:16,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:16,060 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724b65137dd216c48e587e6fd44977269a2 2023-07-24 13:08:16,061 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,145 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:16,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:16,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:16,147 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:08:16,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 13:08:16,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,232 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690204095840Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690204096089 (+249 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690204096089Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690204096089Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690204096098 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690204096167 (+69 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690204096232 (+65 ms) 2023-07-24 13:08:16,236 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:16,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 395 msec 2023-07-24 13:08:16,447 DEBUG [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:16,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:16,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:08:16,448 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448 2023-07-24 13:08:16,449 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37143, tgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448, rawTgtDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448, srcFsUri=hdfs://localhost:37143, srcDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:08:16,480 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e 2023-07-24 13:08:16,480 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-442772813_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,480 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37143, inputRoot=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e, snapshotDir=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 13:08:16,496 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:16,527 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:16,527 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:16,528 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:16,528 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,773 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-5418729351725825235.jar 2023-07-24 13:08:17,774 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,774 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,871 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/hadoop-4460478324875022325.jar 2023-07-24 13:08:17,872 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,872 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,873 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,874 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,875 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,875 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:17,876 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:08:17,876 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:08:17,877 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:08:17,877 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:08:17,877 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:08:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:08:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:08:17,878 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:08:17,879 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:08:17,879 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:08:17,880 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:17,880 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:17,881 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:17,881 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:17,881 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:17,882 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:17,882 DEBUG [Listener at jenkins-hbase4.apache.org/44893] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:18,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0006_000001 (auth:SIMPLE) 2023-07-24 13:08:19,421 WARN [Listener at jenkins-hbase4.apache.org/44893] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:08:19,424 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 13:08:19,427 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 13:08:19,691 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:08:19,691 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:08:19,743 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:08:19,954 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:26,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:29,007 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:32,498 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:34,002 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:08:34,003 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:08:34,023 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,023 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:08:34,024 INFO [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:08:34,024 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 13:08:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 13:08:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1743295439_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 13:08:34,025 DEBUG [Listener at jenkins-hbase4.apache.org/44893] snapshot.TestExportSnapshot(367): hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/export-test/export-1690204096448/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 13:08:34,032 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 13:08:34,057 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204114057"}]},"ts":"1690204114057"} 2023-07-24 13:08:34,060 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 13:08:34,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 13:08:34,152 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 13:08:34,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, UNASSIGN}] 2023-07-24 13:08:34,158 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, UNASSIGN 2023-07-24 13:08:34,159 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, UNASSIGN 2023-07-24 13:08:34,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=37a613a8ab49bafcbc5335c4e52f980e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:08:34,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4e7b6eff6591904126e5163225fa39a2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:08:34,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204114161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204114161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204114161"}]},"ts":"1690204114161"} 2023-07-24 13:08:34,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204114161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204114161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204114161"}]},"ts":"1690204114161"} 2023-07-24 13:08:34,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 37a613a8ab49bafcbc5335c4e52f980e, server=jenkins-hbase4.apache.org,43445,1690203973024}] 2023-07-24 13:08:34,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 4e7b6eff6591904126e5163225fa39a2, server=jenkins-hbase4.apache.org,37237,1690203973072}] 2023-07-24 13:08:34,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 37a613a8ab49bafcbc5335c4e52f980e, disabling compactions & flushes 2023-07-24 13:08:34,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. after waiting 0 ms 2023-07-24 13:08:34,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:34,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e7b6eff6591904126e5163225fa39a2, disabling compactions & flushes 2023-07-24 13:08:34,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. after waiting 0 ms 2023-07-24 13:08:34,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:34,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:34,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:34,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2. 2023-07-24 13:08:34,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e7b6eff6591904126e5163225fa39a2: 2023-07-24 13:08:34,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e. 2023-07-24 13:08:34,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 37a613a8ab49bafcbc5335c4e52f980e: 2023-07-24 13:08:34,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:34,338 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=37a613a8ab49bafcbc5335c4e52f980e, regionState=CLOSED 2023-07-24 13:08:34,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:34,338 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204114337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204114337"}]},"ts":"1690204114337"} 2023-07-24 13:08:34,338 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4e7b6eff6591904126e5163225fa39a2, regionState=CLOSED 2023-07-24 13:08:34,338 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204114338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204114338"}]},"ts":"1690204114338"} 2023-07-24 13:08:34,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 13:08:34,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 37a613a8ab49bafcbc5335c4e52f980e, server=jenkins-hbase4.apache.org,43445,1690203973024 in 172 msec 2023-07-24 13:08:34,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 13:08:34,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 4e7b6eff6591904126e5163225fa39a2, server=jenkins-hbase4.apache.org,37237,1690203973072 in 173 msec 2023-07-24 13:08:34,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=37a613a8ab49bafcbc5335c4e52f980e, UNASSIGN in 187 msec 2023-07-24 13:08:34,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 13:08:34,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4e7b6eff6591904126e5163225fa39a2, UNASSIGN in 187 msec 2023-07-24 13:08:34,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204114343"}]},"ts":"1690204114343"} 2023-07-24 13:08:34,344 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 13:08:34,346 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 13:08:34,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 313 msec 2023-07-24 13:08:34,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 13:08:34,350 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 13:08:34,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,354 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,354 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,358 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41971] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,361 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,361 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,361 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,361 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:34,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:34,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:34,362 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:34,362 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:34,363 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:34,365 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/recovered.edits] 2023-07-24 13:08:34,365 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf, FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/recovered.edits] 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:34,368 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:34,369 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf/7cce194c819d447eaa8300597cad92be to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/cf/7cce194c819d447eaa8300597cad92be 2023-07-24 13:08:34,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 13:08:34,370 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf/5100253d84e44707be8e93eac6a2d233 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/cf/5100253d84e44707be8e93eac6a2d233 2023-07-24 13:08:34,373 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2/recovered.edits/9.seqid 2023-07-24 13:08:34,375 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4e7b6eff6591904126e5163225fa39a2 2023-07-24 13:08:34,376 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/recovered.edits/9.seqid to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e/recovered.edits/9.seqid 2023-07-24 13:08:34,376 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/37a613a8ab49bafcbc5335c4e52f980e 2023-07-24 13:08:34,376 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 13:08:34,377 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 13:08:34,378 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 13:08:34,384 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724ab224dbfee40480a8116cc3635ed7af7 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724ab224dbfee40480a8116cc3635ed7af7 2023-07-24 13:08:34,387 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724b65137dd216c48e587e6fd44977269a2 to hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724b65137dd216c48e587e6fd44977269a2 2023-07-24 13:08:34,387 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 13:08:34,390 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,393 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 13:08:34,395 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 13:08:34,396 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,396 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 13:08:34,396 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204114396"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:34,397 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204114396"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:34,398 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:08:34,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4e7b6eff6591904126e5163225fa39a2, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690204094353.4e7b6eff6591904126e5163225fa39a2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 37a613a8ab49bafcbc5335c4e52f980e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204094353.37a613a8ab49bafcbc5335c4e52f980e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:08:34,398 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 13:08:34,399 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204114399"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:34,400 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 13:08:34,402 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 51 msec 2023-07-24 13:08:34,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 13:08:34,471 INFO [Listener at jenkins-hbase4.apache.org/44893] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 13:08:34,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 13:08:34,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 13:08:34,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:34,516 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 760) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:37513 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:41938 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-821273747_1 at /127.0.0.1:35020 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5434 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-442772813_17 at /127.0.0.1:43102 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743295439_17 at /127.0.0.1:35052 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5538a1e8-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=897 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=686 (was 602) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 178), AvailableMemoryMB=4707 (was 5642) 2023-07-24 13:08:34,516 WARN [Listener at jenkins-hbase4.apache.org/44893] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 13:08:34,516 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 13:08:34,541 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:08:38,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982289_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:39,905 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:08:48,668 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:09:02,795 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 13:09:02,796 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:09:02,809 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 13:09:02,825 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 13:09:02,827 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 13:09:02,845 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:09:02,950 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 13:09:02,950 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 13:09:02,950 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 13:09:02,950 INFO [Listener at jenkins-hbase4.apache.org/44893] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 13:09:02,950 DEBUG [Listener at jenkins-hbase4.apache.org/44893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0aad9b51 to 127.0.0.1:63130 2023-07-24 13:09:02,950 DEBUG [Listener at jenkins-hbase4.apache.org/44893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:02,950 DEBUG [Listener at jenkins-hbase4.apache.org/44893] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 13:09:02,950 DEBUG [Listener at jenkins-hbase4.apache.org/44893] util.JVMClusterUtil(257): Found active master hash=1878016116, stopped=false 2023-07-24 13:09:02,951 DEBUG [Listener at jenkins-hbase4.apache.org/44893] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:02,951 DEBUG [Listener at jenkins-hbase4.apache.org/44893] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 13:09:02,951 INFO [Listener at jenkins-hbase4.apache.org/44893] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:09:02,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:09:02,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:09:02,953 INFO [Listener at jenkins-hbase4.apache.org/44893] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 13:09:02,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:09:02,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:09:02,953 DEBUG [Listener at jenkins-hbase4.apache.org/44893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26336b82 to 127.0.0.1:63130 2023-07-24 13:09:02,953 DEBUG [Listener at jenkins-hbase4.apache.org/44893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:02,953 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:09:02,953 INFO [Listener at jenkins-hbase4.apache.org/44893] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41971,1690203972955' ***** 2023-07-24 13:09:02,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:09:02,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:09:02,954 DEBUG [Listener at jenkins-hbase4.apache.org/44893] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:02,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:09:02,954 INFO [Listener at jenkins-hbase4.apache.org/44893] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 13:09:02,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:09:02,954 INFO [Listener at jenkins-hbase4.apache.org/44893] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43445,1690203973024' ***** 2023-07-24 13:09:02,954 DEBUG [Listener at jenkins-hbase4.apache.org/44893] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:02,954 INFO [Listener at jenkins-hbase4.apache.org/44893] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 13:09:02,954 INFO [RS:0;jenkins-hbase4:41971] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 13:09:02,954 INFO [Listener at jenkins-hbase4.apache.org/44893] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37237,1690203973072' ***** 2023-07-24 13:09:02,954 INFO [RS:1;jenkins-hbase4:43445] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 13:09:02,955 DEBUG [Listener at jenkins-hbase4.apache.org/44893] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:02,954 INFO [RS:0;jenkins-hbase4:41971] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 13:09:02,955 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 13:09:02,955 INFO [RS:0;jenkins-hbase4:41971] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 13:09:02,955 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 13:09:02,955 INFO [Listener at jenkins-hbase4.apache.org/44893] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 13:09:02,955 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(3305): Received CLOSE for f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:09:02,955 INFO [RS:1;jenkins-hbase4:43445] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 13:09:02,955 INFO [RS:1;jenkins-hbase4:43445] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 13:09:02,955 INFO [RS:2;jenkins-hbase4:37237] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 13:09:02,955 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:09:02,955 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 13:09:02,955 DEBUG [RS:1;jenkins-hbase4:43445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c306437 to 127.0.0.1:63130 2023-07-24 13:09:02,955 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(3305): Received CLOSE for 084d6909f3ca844c72efabe958826afe 2023-07-24 13:09:02,955 INFO [RS:2;jenkins-hbase4:37237] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 13:09:02,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f5099410dc92ba494eaf33150e0b8653, disabling compactions & flushes 2023-07-24 13:09:02,956 INFO [RS:2;jenkins-hbase4:37237] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 13:09:02,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:09:02,956 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:09:02,955 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:09:02,955 DEBUG [RS:1;jenkins-hbase4:43445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:02,957 DEBUG [RS:0;jenkins-hbase4:41971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c49a4e3 to 127.0.0.1:63130 2023-07-24 13:09:02,959 INFO [RS:1;jenkins-hbase4:43445] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 13:09:02,956 DEBUG [RS:2;jenkins-hbase4:37237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x774278ee to 127.0.0.1:63130 2023-07-24 13:09:02,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:09:02,959 DEBUG [RS:2;jenkins-hbase4:37237] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:02,959 INFO [RS:1;jenkins-hbase4:43445] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 13:09:02,959 DEBUG [RS:0;jenkins-hbase4:41971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:02,959 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37237,1690203973072; all regions closed. 2023-07-24 13:09:02,959 INFO [RS:1;jenkins-hbase4:43445] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 13:09:02,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. after waiting 0 ms 2023-07-24 13:09:02,960 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 13:09:02,960 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 13:09:02,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:09:02,960 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1478): Online Regions={f5099410dc92ba494eaf33150e0b8653=hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653., 084d6909f3ca844c72efabe958826afe=hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe.} 2023-07-24 13:09:02,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f5099410dc92ba494eaf33150e0b8653 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 13:09:02,960 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 13:09:02,961 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-24 13:09:02,961 DEBUG [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1504): Waiting on 084d6909f3ca844c72efabe958826afe, f5099410dc92ba494eaf33150e0b8653 2023-07-24 13:09:02,961 DEBUG [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 13:09:02,962 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 13:09:02,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 13:09:02,962 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 13:09:02,962 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 13:09:02,962 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 13:09:02,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 13:09:02,999 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:09:02,999 DEBUG [RS:2;jenkins-hbase4:37237] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs 2023-07-24 13:09:02,999 INFO [RS:2;jenkins-hbase4:37237] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37237%2C1690203973072:(num 1690203975334) 2023-07-24 13:09:02,999 DEBUG [RS:2;jenkins-hbase4:37237] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:02,999 INFO [RS:2;jenkins-hbase4:37237] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:09:03,006 INFO [RS:2;jenkins-hbase4:37237] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 13:09:03,023 INFO [RS:2;jenkins-hbase4:37237] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 13:09:03,023 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:09:03,023 INFO [RS:2;jenkins-hbase4:37237] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 13:09:03,023 INFO [RS:2;jenkins-hbase4:37237] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 13:09:03,034 INFO [RS:2;jenkins-hbase4:37237] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37237 2023-07-24 13:09:03,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/.tmp/l/316f421125a24444825497a3204a4770 2023-07-24 13:09:03,043 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:09:03,043 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:09:03,043 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:09:03,044 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:09:03,043 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:09:03,043 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37237,1690203973072 2023-07-24 13:09:03,044 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:09:03,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/.tmp/info/b1ebeac25a6447b88bf853d1e69acf98 2023-07-24 13:09:03,049 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37237,1690203973072] 2023-07-24 13:09:03,050 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37237,1690203973072; numProcessing=1 2023-07-24 13:09:03,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 316f421125a24444825497a3204a4770 2023-07-24 13:09:03,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/.tmp/l/316f421125a24444825497a3204a4770 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/l/316f421125a24444825497a3204a4770 2023-07-24 13:09:03,052 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:09:03,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1ebeac25a6447b88bf853d1e69acf98 2023-07-24 13:09:03,053 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:09:03,055 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37237,1690203973072 already deleted, retry=false 2023-07-24 13:09:03,056 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37237,1690203973072 expired; onlineServers=2 2023-07-24 13:09:03,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 316f421125a24444825497a3204a4770 2023-07-24 13:09:03,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/l/316f421125a24444825497a3204a4770, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 13:09:03,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f5099410dc92ba494eaf33150e0b8653 in 97ms, sequenceid=18, compaction requested=false 2023-07-24 13:09:03,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/acl/f5099410dc92ba494eaf33150e0b8653/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 13:09:03,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:03,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:09:03,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f5099410dc92ba494eaf33150e0b8653: 2023-07-24 13:09:03,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690203976873.f5099410dc92ba494eaf33150e0b8653. 2023-07-24 13:09:03,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 084d6909f3ca844c72efabe958826afe, disabling compactions & flushes 2023-07-24 13:09:03,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:09:03,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:09:03,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. after waiting 0 ms 2023-07-24 13:09:03,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:09:03,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 084d6909f3ca844c72efabe958826afe 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 13:09:03,070 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/.tmp/rep_barrier/cf3f4e9a64b34f97bf501863f84b317c 2023-07-24 13:09:03,075 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf3f4e9a64b34f97bf501863f84b317c 2023-07-24 13:09:03,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/.tmp/table/bc6b248392e74b42a13ad41e04678611 2023-07-24 13:09:03,117 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/.tmp/info/cb71a39e0d2b4e2b9f464f1aa5ebdb71 2023-07-24 13:09:03,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc6b248392e74b42a13ad41e04678611 2023-07-24 13:09:03,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/.tmp/info/cb71a39e0d2b4e2b9f464f1aa5ebdb71 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/info/cb71a39e0d2b4e2b9f464f1aa5ebdb71 2023-07-24 13:09:03,122 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/.tmp/info/b1ebeac25a6447b88bf853d1e69acf98 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/info/b1ebeac25a6447b88bf853d1e69acf98 2023-07-24 13:09:03,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/info/cb71a39e0d2b4e2b9f464f1aa5ebdb71, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 13:09:03,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1ebeac25a6447b88bf853d1e69acf98 2023-07-24 13:09:03,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/info/b1ebeac25a6447b88bf853d1e69acf98, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 13:09:03,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 084d6909f3ca844c72efabe958826afe in 57ms, sequenceid=6, compaction requested=false 2023-07-24 13:09:03,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/.tmp/rep_barrier/cf3f4e9a64b34f97bf501863f84b317c as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/rep_barrier/cf3f4e9a64b34f97bf501863f84b317c 2023-07-24 13:09:03,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf3f4e9a64b34f97bf501863f84b317c 2023-07-24 13:09:03,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/rep_barrier/cf3f4e9a64b34f97bf501863f84b317c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 13:09:03,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/.tmp/table/bc6b248392e74b42a13ad41e04678611 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/table/bc6b248392e74b42a13ad41e04678611 2023-07-24 13:09:03,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/namespace/084d6909f3ca844c72efabe958826afe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:09:03,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:03,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc6b248392e74b42a13ad41e04678611 2023-07-24 13:09:03,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:09:03,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 084d6909f3ca844c72efabe958826afe: 2023-07-24 13:09:03,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/table/bc6b248392e74b42a13ad41e04678611, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 13:09:03,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690203976123.084d6909f3ca844c72efabe958826afe. 2023-07-24 13:09:03,142 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 13:09:03,142 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 13:09:03,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 180ms, sequenceid=131, compaction requested=false 2023-07-24 13:09:03,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 13:09:03,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:09:03,152 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 13:09:03,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 13:09:03,153 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 13:09:03,153 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 13:09:03,155 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,155 INFO [RS:2;jenkins-hbase4:37237] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37237,1690203973072; zookeeper connection closed. 2023-07-24 13:09:03,155 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:37237-0x10197705e9f0003, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,155 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22cd3a2e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22cd3a2e 2023-07-24 13:09:03,161 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41971,1690203972955; all regions closed. 2023-07-24 13:09:03,162 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43445,1690203973024; all regions closed. 2023-07-24 13:09:03,170 DEBUG [RS:0;jenkins-hbase4:41971] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs 2023-07-24 13:09:03,170 INFO [RS:0;jenkins-hbase4:41971] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41971%2C1690203972955:(num 1690203975341) 2023-07-24 13:09:03,170 DEBUG [RS:0;jenkins-hbase4:41971] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:03,170 INFO [RS:0;jenkins-hbase4:41971] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:09:03,170 INFO [RS:0;jenkins-hbase4:41971] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 13:09:03,171 INFO [RS:0;jenkins-hbase4:41971] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 13:09:03,171 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:09:03,171 DEBUG [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs 2023-07-24 13:09:03,171 INFO [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43445%2C1690203973024.meta:.meta(num 1690203975702) 2023-07-24 13:09:03,171 INFO [RS:0;jenkins-hbase4:41971] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 13:09:03,171 INFO [RS:0;jenkins-hbase4:41971] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 13:09:03,172 INFO [RS:0;jenkins-hbase4:41971] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41971 2023-07-24 13:09:03,175 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:09:03,175 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:09:03,175 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41971,1690203972955 2023-07-24 13:09:03,176 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41971,1690203972955] 2023-07-24 13:09:03,176 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41971,1690203972955; numProcessing=2 2023-07-24 13:09:03,178 DEBUG [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/oldWALs 2023-07-24 13:09:03,178 INFO [RS:1;jenkins-hbase4:43445] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43445%2C1690203973024:(num 1690203975333) 2023-07-24 13:09:03,178 DEBUG [RS:1;jenkins-hbase4:43445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:03,178 INFO [RS:1;jenkins-hbase4:43445] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:09:03,179 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41971,1690203972955 already deleted, retry=false 2023-07-24 13:09:03,179 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41971,1690203972955 expired; onlineServers=1 2023-07-24 13:09:03,179 INFO [RS:1;jenkins-hbase4:43445] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 13:09:03,179 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:09:03,180 INFO [RS:1;jenkins-hbase4:43445] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43445 2023-07-24 13:09:03,182 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:09:03,182 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43445,1690203973024 2023-07-24 13:09:03,183 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43445,1690203973024] 2023-07-24 13:09:03,183 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43445,1690203973024; numProcessing=3 2023-07-24 13:09:03,184 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43445,1690203973024 already deleted, retry=false 2023-07-24 13:09:03,184 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43445,1690203973024 expired; onlineServers=0 2023-07-24 13:09:03,184 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39637,1690203971407' ***** 2023-07-24 13:09:03,184 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 13:09:03,185 DEBUG [M:0;jenkins-hbase4:39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ecd4a4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:09:03,185 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39637,1690203971407 2023-07-24 13:09:03,185 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39637,1690203971407; all regions closed. 2023-07-24 13:09:03,185 DEBUG [M:0;jenkins-hbase4:39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:09:03,185 DEBUG [M:0;jenkins-hbase4:39637] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 13:09:03,185 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 13:09:03,185 DEBUG [M:0;jenkins-hbase4:39637] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 13:09:03,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690203974779] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690203974779,5,FailOnTimeoutGroup] 2023-07-24 13:09:03,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690203974777] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690203974777,5,FailOnTimeoutGroup] 2023-07-24 13:09:03,185 INFO [M:0;jenkins-hbase4:39637] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 13:09:03,185 INFO [M:0;jenkins-hbase4:39637] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 13:09:03,186 INFO [M:0;jenkins-hbase4:39637] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 13:09:03,186 DEBUG [M:0;jenkins-hbase4:39637] master.HMaster(1512): Stopping service threads 2023-07-24 13:09:03,186 INFO [M:0;jenkins-hbase4:39637] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 13:09:03,186 ERROR [M:0;jenkins-hbase4:39637] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 13:09:03,187 INFO [M:0;jenkins-hbase4:39637] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 13:09:03,187 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 13:09:03,187 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 13:09:03,187 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:09:03,189 DEBUG [M:0;jenkins-hbase4:39637] zookeeper.ZKUtil(398): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 13:09:03,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:09:03,189 WARN [M:0;jenkins-hbase4:39637] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 13:09:03,190 INFO [M:0;jenkins-hbase4:39637] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 13:09:03,190 INFO [M:0;jenkins-hbase4:39637] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 13:09:03,190 DEBUG [M:0;jenkins-hbase4:39637] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 13:09:03,191 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:09:03,191 DEBUG [M:0;jenkins-hbase4:39637] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:09:03,191 DEBUG [M:0;jenkins-hbase4:39637] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 13:09:03,191 DEBUG [M:0;jenkins-hbase4:39637] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:09:03,191 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.83 KB heapSize=452.08 KB 2023-07-24 13:09:03,213 INFO [M:0;jenkins-hbase4:39637] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.83 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5efd20e4ff744def853444fd83ede250 2023-07-24 13:09:03,217 INFO [M:0;jenkins-hbase4:39637] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efd20e4ff744def853444fd83ede250 2023-07-24 13:09:03,218 DEBUG [M:0;jenkins-hbase4:39637] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5efd20e4ff744def853444fd83ede250 as hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5efd20e4ff744def853444fd83ede250 2023-07-24 13:09:03,222 INFO [M:0;jenkins-hbase4:39637] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efd20e4ff744def853444fd83ede250 2023-07-24 13:09:03,222 INFO [M:0;jenkins-hbase4:39637] regionserver.HStore(1080): Added hdfs://localhost:37143/user/jenkins/test-data/36df8c3b-b5a5-5717-8b1c-785302cc227e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5efd20e4ff744def853444fd83ede250, entries=119, sequenceid=899, filesize=28.7 K 2023-07-24 13:09:03,223 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegion(2948): Finished flush of dataSize ~375.83 KB/384854, heapSize ~452.06 KB/462912, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=899, compaction requested=false 2023-07-24 13:09:03,224 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:09:03,224 DEBUG [M:0;jenkins-hbase4:39637] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 13:09:03,227 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:09:03,227 INFO [M:0;jenkins-hbase4:39637] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 13:09:03,228 INFO [M:0;jenkins-hbase4:39637] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39637 2023-07-24 13:09:03,229 DEBUG [M:0;jenkins-hbase4:39637] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39637,1690203971407 already deleted, retry=false 2023-07-24 13:09:03,277 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,277 INFO [RS:0;jenkins-hbase4:41971] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41971,1690203972955; zookeeper connection closed. 2023-07-24 13:09:03,278 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:41971-0x10197705e9f0001, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,278 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5806625c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5806625c 2023-07-24 13:09:03,378 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,378 INFO [M:0;jenkins-hbase4:39637] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39637,1690203971407; zookeeper connection closed. 2023-07-24 13:09:03,378 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): master:39637-0x10197705e9f0000, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,478 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,478 INFO [RS:1;jenkins-hbase4:43445] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43445,1690203973024; zookeeper connection closed. 2023-07-24 13:09:03,478 DEBUG [Listener at localhost/33675-EventThread] zookeeper.ZKWatcher(600): regionserver:43445-0x10197705e9f0002, quorum=127.0.0.1:63130, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:09:03,478 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@442c6299] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@442c6299 2023-07-24 13:09:03,478 INFO [Listener at jenkins-hbase4.apache.org/44893] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 13:09:03,479 WARN [Listener at jenkins-hbase4.apache.org/44893] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 13:09:03,485 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:09:03,589 WARN [BP-1421455664-172.31.14.131-1690203966826 heartbeating to localhost/127.0.0.1:37143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 13:09:03,589 WARN [BP-1421455664-172.31.14.131-1690203966826 heartbeating to localhost/127.0.0.1:37143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1421455664-172.31.14.131-1690203966826 (Datanode Uuid 79a1c959-ee9a-4960-a5ce-a17cb1dcecd6) service to localhost/127.0.0.1:37143 2023-07-24 13:09:03,591 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data5/current/BP-1421455664-172.31.14.131-1690203966826] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:09:03,591 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data6/current/BP-1421455664-172.31.14.131-1690203966826] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:09:03,594 WARN [Listener at jenkins-hbase4.apache.org/44893] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 13:09:03,600 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:09:03,706 WARN [BP-1421455664-172.31.14.131-1690203966826 heartbeating to localhost/127.0.0.1:37143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 13:09:03,706 WARN [BP-1421455664-172.31.14.131-1690203966826 heartbeating to localhost/127.0.0.1:37143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1421455664-172.31.14.131-1690203966826 (Datanode Uuid 2b4f0577-1fde-4091-8ba3-f8858c5b30f6) service to localhost/127.0.0.1:37143 2023-07-24 13:09:03,707 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data3/current/BP-1421455664-172.31.14.131-1690203966826] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:09:03,708 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data4/current/BP-1421455664-172.31.14.131-1690203966826] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:09:03,709 WARN [Listener at jenkins-hbase4.apache.org/44893] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 13:09:03,717 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:09:03,722 WARN [BP-1421455664-172.31.14.131-1690203966826 heartbeating to localhost/127.0.0.1:37143] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 13:09:03,722 WARN [BP-1421455664-172.31.14.131-1690203966826 heartbeating to localhost/127.0.0.1:37143] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1421455664-172.31.14.131-1690203966826 (Datanode Uuid f3d63c86-5fd3-4e76-8598-323c1e82607f) service to localhost/127.0.0.1:37143 2023-07-24 13:09:03,723 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data1/current/BP-1421455664-172.31.14.131-1690203966826] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:09:03,723 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41005f60-ad1b-91df-8727-04767e8e551b/cluster_8889a575-b5c8-5cc2-8727-7472b4239252/dfs/data/data2/current/BP-1421455664-172.31.14.131-1690203966826] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:09:03,780 INFO [Listener at jenkins-hbase4.apache.org/44893] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:09:03,818 INFO [Listener at jenkins-hbase4.apache.org/44893] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 13:09:03,920 INFO [Listener at jenkins-hbase4.apache.org/44893] hbase.HBaseTestingUtility(1293): Minicluster is down